close

Scraping Engineer

IT & Technology
Frankfurt

Germany - Frankfurt /

CRM – 773-R&D KOL General /

Full-Time

At Veeva, we build enterprise cloud technology that powers the biggest names in the pharmaceutical, biotech, consumer goods, chemical & cosmetics industries. Our customers make vaccines, life-saving medicines, and life-enhancing products that make a difference in everyday lives. Our technology has transformed these industries; enabling them to get critical products and services to market faster. Our core values, Do the Right Thing, Customer Success, Employee Success, and Speed, guide us as we make our customers more efficient and effective in everything they do.

The Role

A Scraping Engineer is responsible for designing and implementing a generic and flexible web scraping system which automatically scrapes a large number of pages and loads relevant data into our DB. You will implement scrapers and also oversee a team of operators who run the scrapers. The system will crawl thousands of websites (and millions of individual pages) and therefore needs to be extremely scalable. A highly innovative developer with experience in implementing web scrapers is the perfect fit for the role.

What You'll Do

    • Design, implement and run a flexible system to scrape thousands of web sites
    • Implement individual web scrapers
    • Ensure maximum degree of automation and reusability
    • Supervise a team of web scraper operators

Requirements

    • 3+ years of experience as software engineer
    • Experience from a large cloud software enterprise
    • Experience with scraping frameworks (Selenium, Beautifulsoup, Scrapy)
    • Python proficiency
    • Agile mindset

Nice to Have

    • Experience with designing and configuring cloud infrastructures

Perks & Benefits

    • Comprehensive benefits package
    • Annual allocations for continuous learning, development & charitable contributions
    • Fitness reimbursement
    • Monthly social events and weekly team lunch

#LI-Remote

Veeva’s headquarters is located in the San Francisco Bay Area with offices in more than 15 countries around the world.