Engineering Manager – Big Data
3 weeks ago
Job Title: Engineering Manager – Big Data, Azure & Databricks
Location: Remote
Employment Type: Full-time
Department: Data Engineering / Technology
Experience: 8+ years (3+ years in a managerial role)
Salary - 30 LPA
About the Role:
We are seeking a highly experienced and strategic Engineering Manager with deep expertise in Big Data platforms, Microsoft Azure, and Databricks. The ideal candidate will lead a team of talented data engineers to design and deliver scalable data pipelines and analytics platforms, ensuring high performance, reliability, and security in a cloud-native environment.
Key Responsibilities:
- Lead, mentor, and grow a team of data engineers working on large-scale distributed data systems.
- Architect and oversee the development of end-to-end data solutions using Azure Data Services and Databricks.
- Collaborate with cross-functional teams including data science, analytics, product, and business stakeholders to understand requirements and deliver impactful data products.
- Drive best practices in data engineering, coding standards, version control, CI/CD, and monitoring.
- Ensure high data quality, governance, and compliance with internal and external policies.
- Optimize performance and cost efficiency of data infrastructure in the cloud.
- Stay current with industry trends, emerging technologies, and apply them to improve system architecture and team capabilities.
Required Skills & Qualifications:
- Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
- 8+ years of experience in software/data engineering with at least 3 years in a leadership or managerial role.
- Proven hands-on experience with:
- Big Data ecosystems (Spark, Hive, Hadoop)
- Azure Cloud Services (Data Lake, Data Factory, Synapse Analytics, Blob Storage)
- Databricks (including Delta Lake, MLFlow, Unity Catalog)
- Strong programming experience in Python, Scala, or Java.
- Deep understanding of data modeling, ETL/ELT processes, and performance tuning.
- Experience managing Agile teams and delivering complex projects on time.
- Excellent problem-solving, leadership, and communication skills.
Preferred Qualifications:
- Certification in Azure Data Engineer or Azure Solutions Architect.
- Experience with data governance, security, and compliance (e.g., GDPR, HIPAA).
- Familiarity with ML/AI workflows and collaboration with data science teams.
-
Big Data Engineer
2 weeks ago
india, IN Alef Education Full timeWho we areAlef Education began with a bold idea: that every learner deserves a personalised and meaningful education experience. What started in 2016 as a small pilot programme in Abu Dhabi has evolved into one of the world’s most dynamic EdTech companies—reshaping how millions of students engage with learning across the globe.Today, Alef is proudly...
-
Senior Big Data Engineer
3 weeks ago
india, IN Veltris Full timeVeltris is a Digital Product Engineering Services partner committed to driving technology-enabled transformation across enterprises, businesses, and industries. We specialize in delivering next-generation solutions for sectors including healthcare, technology, communications, manufacturing, and finance. With a focus on innovation and acceleration, Veltris...
-
Big Data Developer
2 weeks ago
india, IN BayOne Solutions Full timeJob Description:We are seeking a highly skilled Full Stack Big Data Engineer to join our team. The ideal candidate will have strong expertise in big data technologies, cloud platforms, microservices, and system design, with the ability to build scalable and efficient data-driven applications. This role requires hands-on experience across data engineering,...
-
india, IN Extreme Networks Full timeOver 50,000 customers globally trust our end-to-end, cloud-driven networking solutions. They rely on our top-rated services and support to accelerate their digital transformation efforts and deliver unprecedented progress. With double-digit growth year over year, no provider is better positioned to deliver scalable outcomes than Extreme.Inclusion is one of...
-
Big Data Engineer
3 weeks ago
india, IN Sky Systems, Inc. Full timeRole: Big Data EngineerPosition Type: Full-Time Contract (40hrs/week)Contract Duration: Long TermWork Schedule: 8 hours/day (Mon-Fri)Location: Hybrid - Hyderabad, India (3x days onsite/week)We are looking for a skilled Big Data Engineer (5+ years’ experience) to join Experian’s dynamic data engineering team. You will design and optimize scalable data...
-
Data Engineer
2 weeks ago
india, IN Dautom Full timeJob Description: Data Engineer (Big Data/Kafka) We are seeking a highly experienced Senior Data Engineer with a deep background in Big Data technologies to join our team. This is a contract role for a major project in the Banking sector.Key Details:Role: Data EngineerIndustry: Banking (Financial Services)Work Location: Remote (India)Contract Duration: 6...
-
Big Data with Quantexa-Pan India
3 weeks ago
, India, IN Tata Consultancy Services Full timeDear Candidates,Greetings from TCS TAG team,We are looking for Big data developer with Quantexa as mandatory skill.Location-Pan IndiaExperience Range- 5 to 12 yearsData Engineer - Big Data Hadoop, Spark and ScalaSpark, Scala, Hadoop, HIVE, Oozie, Shell Script, Quantexa(Mandatory)Please hit apply button and fill details for the job application.Desired...
-
Data Engineer
2 weeks ago
india, IN Insight Global Full timePosition: GCP Data Engineer Location: 100% Remote in IndiaDuration: 12 month contract + extensions + conversionsPackage: 10 LPA- 26 LPAInterview Process: 2 RoundsREQUIRED SKILLS AND EXPERIENCE6+ Years of experience as a Data Engineer Experience with GCP Data ie. Big Query, Cloud Storage, BigTable, Airflow, Dataproc, Dataflow Strong SQL experience (NoSQL,...
-
Data Engineer
2 weeks ago
india, IN Sapaad Full timeWHO WE ARESapaad is a global leader in unified commerce platforms, delivering world-class software solutions for the food and beverage industry. Our flagship product, also named Sapaad, has achieved remarkable success over the past decade, empowering thousands of F&B businesses across 40+ countries—with many more coming onboard each day.Driven by a...
-
Hiring for Java Big Data
2 weeks ago
, India, IN Deloitte Full timeDeloitte India is hiring for Java + Big Data (Big data is mandatory) candidates for Chennai location. Interested candidates can apply.Looking for 6 to 9 Years of experience candidates.Job descriptionRole - Key Responsibilities:Big Data Technologies - Hadoop, Apache Spark, Apache Kafka, Flink (Good to have)Develop and maintain scalable backend services using...