Tactical, Operational & Strategic Analysis of Markets, Competitors & Industries

How and why we have created a search engine WebInsight

Google Translate from russian - http://translate.google.com/translate?js=n&prev=_t&hl=ru&am...

Brief Summary

WebInsight - search engine on the invisible part of the Internet, namely the documents FTS, FSSP, the Pension Fund, FAS, the Labour Inspectorate, the Fed, the Emergencies Ministry, the Arbitral Tribunal, the Interior Ministry, FSB, as well as instruments of law enforcement, regulatory and supervisory bodies of the CIS : Ukraine, Uzbekistan, Kazakhstan, Byelorussia, Moldova, Transdniestria, Tajikistan, Azerbaijan, Kyrgyzstan, Abkhazia, etc.

Invisible Web

Every day there are millions of Web documents, such as private individuals and companies and even government departments. Unfortunately for us all, search engines are often unable to index them all. This is due to several reasons:
1. link to the document is not published on the famous search engine page;
2. documents are laid out in an unknown format for the robot, often simply compressed rare type of archiving. kgb, etc.;
3. documents are laid out as a database, the result of the issuance of information which depends on the query;
4. Indexing a site is forbidden file robots.txt;
5. once again laid out documents, quickly removed from the server and not having time to index.

All this leads to the so-called invisible web. Quite understandable in all languages, the invisible web, this is part of the network, which is not seen by search robots, and as a consequence we do not see you. According to various experts, the invisible web is a fraction of 20% to 50% of the entire content network that will agree is not quite enough, especially if you work with the information and the Internet in your work has played a key role!

Invisible Web and the State

With the arrival of Dmitry Medvedev, to government agencies were tasked to increase their presence on the Internet. This should lead to the emergence of interactive services on the sites of departments and hence to raise awareness about their work. After all, one of the work of many agencies is the creation of various documents, which are so essential to entrepreneurs to minimize their business risks. These are the following documents: lists of debtors (companies) for taxes, lists of entrepreneurs - the debtors of taxes, lists of debtors to alimony; lists natural person debtor transport tax; list of disqualified persons, list of companies registered on forged passports, lists the mass registration list of companies registered to addresses media registration lists of companies whose promoters are widespread; massive lists of applicants, lists of the debtor company on payment of wages; lists unscrupulous suppliers of state structures, lists of persons involved in terrorist activities, lists of persons involved in money laundering ; lists of wanted persons on suspicion of a crime; revocation lists Inn and OGRN etc.

Have this information is essential, since working with persons specified in these lists, you come to the attention of control and law enforcement agencies as an accessory!

Hearing the call Medvedev to raise awareness about their activities, many of the agencies' stupidly "began to spread such files on their Web sites, as well as computer literacy level among many of the staff data Offices frankly leaves a lot to be desired, it resulted that was written above - the invisible internet! That is the desire to hurry before the eyes of the president to report on improving the level of openness to the taxpayer has led to the fact that such information may be used only by units! And that is why, in order to verify your counterparty to the involvement of illegal activity you will need:
1. identify any regional site requires you to agencies;
2. find them these lists, which is extremely problematic;
3. Download lists;
4. open the file in the required format;
5. to search;
6. move to point 1 and start looking for another agency!

But agencies that publish such lists have more than ten: FTS, FSSP, Federal Financial Monitoring Service, the Pension Fund, FAS, the Labour Inspectorate, the Fed, MOE, the Arbitral Tribunal, the Interior Ministry, FSB, etc. Thus to implement a procedure "Know Your Customer - Know your customer», which is obligatory for the entire civilized Western business in the Russian conditions is practically impossible, or leads to higher costs of human resources!

WebInsight

Employees R-Techno, which specializes in business intelligence, came to the conclusion that creating a single search service for similar documents - WebInsight! For a long time staff of the R-Techno "was conducted into sites of government agencies to identify" hidden "documents. The result of this work was the - algorithm development and monitoring of robot for pumping the documents of interest sites. At this point in time, a year after launching the service, you can openly acknowledge it as one of the most successful projects of the company, which is absolutely free of charge to much needed information to analysts, business intelligence and professional security services, as well as anyone. Service has more than 25,000 documents, such as the Russian state structures, and the CIS countries and international organization fighting money laundering and terrorist financing. Tags: