Scraping Engineer (H/F) - Internship - Paris

Since 2014, Wiremind has positioned itself as a tech company transforming the world of transport and events with a 360° approach combining UX, software, and AI .

Our expertise lies primarily in optimizing and marketing our clients' capacity. We work on various projects such as ticket forecasting and pricing , 3D optimization of air freight or scraping competitor prices . Our applications are the preferred tool of companies such as SNCF, United Airlines, Qatar Airways or even PSG to visualize, analyze and optimize their capacity.

Dynamic and ambitious, we strive to maintain our technical DNA which is the engine of our success. The company, profitable and self-financed since its creation 10 years ago, is mainly composed of engineers and experts and currently supports the growth of our business model based on "software-as-a-service" solutions.

Your missions 🚀

As a Scraping Intern , you will join the scraping team and take part in the development of new scrapers for our solution named Cayzn Tracking. You will solve business and technical enquiries raised by our customers, by working together with a experimented Scraping Engineer, who will support you in your progression and with the support of our Product Experts and Platform Engineers.

In practice – even though there is no typical day – you can expect to:

• Develop new web scrapers (spiders) , to gather and collect data from specific sources (websites, APIs) , and convey this data through multiple steps and pipelines: cleaning the data, parsing and then saving it to our datastore
• Learn how to by-pass and bring anti-ban methods deployed by different sources, using our well-advanced tools in the term of scraping (eg. headless browser, rotating proxy middleware) and share ideas to improve our solution
• Maintain actual scrapers to assure the continuous flow of data, fixing and adapting our code in case of changes of the scraped sources

Technical stack:

• Backend : Python 3.11+ with SQLAlchemy
• Scraping : Scrapy framework, headless browser solutions, rotating proxy solution
• Data-store : Postgresql, Elasticsearch, Redis
• Gilab for CI/CD
• Kubernetes for infrastructure
• Prometheus/Grafana and Kibana for operations

Your profile 🔍

• Above average in terms of rigor and autonomy, you are proactive and curious.
• Good general culture in computer science and you are looking for a quick progression perspective in an environment with best development practices.
• Interested in solving business problems through technological solutions.

Our benefits 🤌

By joining us, you will integrate:

• A self-financed startup with a strong tech identity! 🧬
• Beautiful 800 m² offices in the heart of Paris (Bd Poissonnière) ✨
• Attractive remuneration 💪
• A caring and stimulating team that encourages skills development through initiative and autonomy
• A learning environment with opportunities for evolution 🧑‍💻

You will also benefit from:

• 1 day of remote work per week
• A great company culture (monthly afterworks, regular meetings on technology and products, annual off-site seminars, team-building…)

Our Recruitment Process 🤞

1. An initial discussion with our Talent Acquisition Manager
2. A technical screening interview with the Lead Scraping Engineer
3. A technical test to be prepared
4. A last interview at our offices to discuss your technical test with the hiring manager and meet with members of the team

Wiremind is committed to equality of opportunity, diversity, and fairness . We encourage all candidates with the necessary experience to apply for our job offers.