Senior Data Engineer - Intelligent Search (f/m/d)
About this role
We help the world run better. At SAP, we keep it simple: you bring your best to us, and we'll bring out the best in you. We're builders touching over 20 industries and 80% of global commerce, and we need your unique talents to help shape what's next. The work is challenging – but it matters. You'll find a place where you can be yourself, prioritize your wellbeing, and truly belong. What's in it for you? Constant learning, skill growth, great benefits, and a team that wants you to grow and succeed.
Summary: The Senior Data Engineer - Intelligent Search (f/m/d) builds scalable crawlers, ingestion, enrichment, and indexing pipelines that power SAP's AI Search service offering for multiple scenarios within the company. Join a collaborative team delivering fresh, high-quality content and reliable search across the enterprise.
What you'll do
- Join a global, agile delivery team to extract, enrich, and deliver high-quality data powering a wide range of SAP use cases
- Develop and continuously evolve a JavaScript/TypeScript-based modular crawler framework for high-performance, large-scale data extraction
- Configure new crawler jobs in close collaboration with data source owners and service teams
- Integrate with REST and GraphQL APIs to acquire and enrich data
- Ingest and process datasets with the use of AI/ML in Databricks using PySpark and Delta Lake to integrate processed data into target systems such as OpenSearch and Coveo
- Monitor and troubleshoot crawler jobs on Kubernetes; analyze logs, execute tests, and debug issues
- Improve data quality and optimize/maintain crawlers and modules using established tooling
- Collaborate closely within your team and with supporting units and stakeholders
What you bring
- University Degree in Computer Science, Engineering, or similar
- 5+ years of professional working experience in software development
- Strong proficiency in Node.js, TypeScript, and Python/PySpark
- Proven web crawling, HTML parsing, and REST/GraphQL API integration skills
- Experience applying AI/ML to data enrichment workflows
- Hands-on with Databricks, Delta Lake, and Azure ADLS Gen2
- Experience with OpenSearch/Elasticsearch (optionally Coveo)
- Understanding of Kubernetes, Docker, and containerized execution
- Experience with designing, implementing, and maintaining CI/CD pipelines
- Strong log analysis and troubleshooting skills
- Proficient in both German and English, with strong communication skills
Meet your team
The Intelligent Search team, a part of the Corporate Processes & Information Technology (CPIT) organization within SAP, is on an exciting journey to develop, enhance, and operate the strategic Intelligent Search Service end-to-end. This includes the whole process from gathering content from various source systems through crawling, AI Search and UI development, and integration into consuming websites, platforms, or agentic AIs. As we drive the adoption of our service, we actively collaborate with various critical LoBs and teams within SAP. Our solutions are globally utilized by customers, partners, and employees. The team consists of motivated individuals from various locations, primarily working out of the EMEA region. We value curiosity, quality, and collaboration to support our organization-wide AI strategy.
Bring out your best
SAP innovations help more than four hundred thousand customers worldwide work together more efficiently and use business insight more effectively. Originally known for leadership in enterprise resource planning (ERP) software, SAP has evolved to become a market leader in end-to-end business application software and related services for database, analytics, intelligent technologies, and experience management. As a cloud company with two hundred million users and more than one hundred thousand employees worldwide, we are purpose‑driven and future‑focused, with a highly collaborative team ethic and commitment to personal development. Whether connecting global industries, people, or platforms, we help ensure every challenge gets the solution it deserves. At SAP, you can bring out your best.
We win with inclusion
SAP’s culture of inclusion, focus on health and well‑being, and flexible working models help ensure that everyone – regardless of background – feels included and can run at their best. At SAP, we believe we are made stronger by the unique capabilities and qualities that each person brings to our company, and we invest in our employees to inspire confidence and help everyone realize their full potential. We ultimately believe in unleashing all talent and creating a better world.
AI Usage in the Recruitment Process
For information on the responsible use of AI in our recruitment process, please refer to the Guidelines for Ethical Usage of AI in the Recruiting Process.