Senior Data Engineer (Python & Big Data)

Join DataWeave as a Senior Data Engineer to solve the world s toughest data problems by making sense of messy public web data at a serious scale. You will be part of a high-growth SaaS platform, building robust data pipelines and scalable python code that powers digital shelf analytics for over 400 global brands.

• Inclined towards working in a dynamic start-up environment with frequent code testing and deployment. Design and build robust, scalable data engineering solutions for both structured and unstructured data. Troubleshoot and debug data completeness and quality issues while optimizing overall system performance. Develop robust APIs to power delivery points including dashboards, visualizations, and integrations. Write effective crawler bots for web data collection using reverse engineering and scalable Python. Manage big data pipelines to deliver actionable intelligence and business reporting to customers.

• 4 to 7 years of professional experience with strong collaboration and communication skills. Expert level proficiency in Python programming and a strong grasp of CS fundamentals. Experience in building complex data pipelines and processing very large datasets. Strong understanding of RDBMS and data management skills. Knowledge of building web crawlers and data mining is a significant advantage. Familiarity with open-source tools like MySQL, Solr, ElasticSearch, Cassandra, or similar data stores.

• Competitive salary packages with fast-paced career growth opportunities. Flexible working hours and a culture of openness with a flat hierarchy. Opportunity to work on challenging datasets involving huge text and image data. Learning opportunities through sponsored courses and technical conferences. Mentorship from senior team members in a fun and engaging work environment.