Data Engineering
AWS
Databricks
Unity Catalog
Data Governance
AI Lifecycle
SQL
Python
ETL Pipelines
Data Quality
📍 Location: Bangalore, KA
Industry: IT
Job Type: Full Time
🏠 Work From Home
Job Summary:
Join CAI as a Data Engineer to own the end-to-end AI data lifecycle using AWS and Databricks. You will ensure data integrity and governance, building robust pipelines that power dependable model outcomes for global enterprise solutions.
Roles & Responsibilities:
Own the end-to-end AI data lifecycle from governed ingestion to training and evaluation datasets. Build and operate incremental, cost-aware ingestion pipelines from enterprise sources into Databricks. Establish BU-oriented AI Data Governance using Unity Catalog and AWS controls. Implement automated quality checks including schema validation and distribution stability monitoring. Optimize data storage and compute strategies including Delta optimization and cluster sizing. Develop and maintain an AI data roadmap aligned with the TE Sensors business unit. Collaborate with the DIA Dashboard organization and internal database teams to transform into an AI-first model. Provide operational support through runbooks, pipeline recovery, and root cause analysis.
Requirements:
Bachelor s degree in Computer Science, Data Science, AI/ML, or a related Engineering field. 5+ years of overall experience in Data Engineering and Data Management. Proven expertise in AWS and Databricks platforms (Unity Catalog, Delta Lake). Strong understanding of Data Quality Engineering and AI/ML data foundations. Ability to manage PII/PCI/Confidential tagging and implement data retention rules. Experience with Spark, Python, and SQL for building reliable data pipelines.
Perks & Benefits:
Work with a global services firm with over 40 years of excellence. Opportunities to work on cutting-edge AI-first initiatives and neurodiversity projects. Competitive professional environment with a focus on talent and technology integration. Access to enterprise-level AWS and Databricks infrastructure.
⚠️ JOB SAFETY ADVISORY
Real companies in India NEVER ask for money.
If asked for Registration or Processing fees, it is a SCAM.
Stop all contact and report them immediately.
Join iNetFrame Technologies to drive AI and Machine Learning innovations. We are looking for experienced Data Annotators to handle complex labeling tasks and ensure...
Join a fast-growing SaaS company to build high-scale communication APIs and Bulk SMS solutions used by over 200,000 businesses. Develop and maintain scalable backend...
Join a high-growth product team in Bengaluru to build scalable, high-performance frontend applications using modern Angular frameworks and TDD practices. Architect and...
Join a dynamic team in Bangalore as an SAP expert, focusing on high-impact projects and innovative technical solutions. Handle end-to-end SAP BW and ABAP development...
Join a high-performance team building scalable frontend applications with a focus on modern Angular frameworks and engineering excellence. Lead the development of...
Cogniter Technologies is looking for a motivated Business Development Executive to join our growing sales team in Chandigarh. This role is a perfect launchpad for...
Kickstart your career in the IT industry with Blueslag Technologies. We are looking for motivated freshers ready to learn and grow in a dynamic digital environment....
StablX is looking for a growth-driven Local SEO Specialist to lead our Google My Business initiatives. If you have a proven track record of ranking businesses in the...
Join Outreach Monks, a global digital PR agency, to execute high-authority link-building campaigns for international SaaS and eCommerce brands. We are looking for a...
Join SRV Webs as a Senior SEO Executive to lead our organic growth strategies. We are looking for a motivated professional with over 1.5 years of experience to enhance...