We are looking for someone to help us with a web crawler built in python potentially as a long-term support in the Net Knowledge team. We need someone to go through the code of the project and understand how it works to a fine detail. Once knowledgeable in the code, the person should run the crawler in production on a monthly basis over millions of domain names provided via our system and resolve any issues that come up.
The person should have strong skills in python and data science as well as excellent problem solving skills and high level English. Ideally you should have knowledge and experience in infrastructure too such as setting up servers, AWS and databases
About us
We are a very small team (2) of data analysts that have clients in several locations around the world and work exclusively in the industry of domain name registrations and in particularly Top Level Domain Registries. We do a lot of analysis and reporting on the trends in domain registrations and how domains are being used (hence why we run a crawler). As we are a small team we need someone who is friendly, pro-active and has excellent communication skills
