Lead Data Engineer
6 days ago
Experience: 9-12 Years
Domain: eCommerce / Financial Reconciliation
Brief JD:
We are seeking a Sr. Data Engineer own and operate a large-scale data processing and reconciliation platform for an eCommerce enterprise. The role involves execution, support and enhancement of real-time data ingestion and batch processing ETL dataflows (SQL, Python, PySpark, Hive), and SLA based execution of SQL based financial report generation.
You will be responsible for triaging reconciliation issues, performing deep root cause analysis (RCA) using data from MySQL, HBase, and HDFS, and implementing fixes with a focus on process automation, data lineage (DataHub), and platform reliability.
Key Responsibilities:
Execute large scale data processing and report generation for in order to drive successful financial reconciliation on monthly basis. Work closely with the Finance Controllers.
Perform RCA, issue triaging and resolve anomalies
Build and monitor data quality, lineage, and SLA adherence across systems
Enable observability through monitoring dashboards and diagnostics
Required Skills:
Strong hands-on experience with: SQL, Python( or PySpark) Based ETL for a Data Lake environment (or a large DWH platform)
Proficiency in SQL and Python (PySpark) performance tuning, and building complex business logic
Knowledge of data lineage, data governance frameworks, and BI tools (Tableau, ClickView)
Fast learner and willing to learn new data analytics tools, basic java programming and microservices architecture
-
Lead Data Engineer
6 days ago
Pune, Maharashtra, India EXL Talent Acquisition Team Full time ₹ 15,00,000 - ₹ 25,00,000 per yearLead Data Engineer Job DescriptionRole Overview:We are looking for a skilled Lead Data Engineer to design, build, and manage scalable data pipelines and architectures. You will lead a team of data engineers, collaborate with cross-functional stakeholders, and drive best practices in data engineering to support data-driven decision-making.Key...
-
Lead Data Engineer
5 days ago
Pune, Maharashtra, India Jet2 Travel Technologies Pvt Ltd. Full time ₹ 25,00,000 - ₹ 1,00,00,000 per yearJob Title: Lead Data EngineerJob Type: PermanentRelevant Experience: 8+ years experience in a data-related role with recent experience in the field of cloud data engineering. Experience of cloud data analytics and data warehousing would be an advantage.Reports to: Engineering Manager – Data & AnalyticsJob Description:We, at Jet2 (UK's third largest...
-
Data Engineer Lead
1 week ago
Pune, Maharashtra, India Mappy Global Resources Full time ₹ 6,00,000 - ₹ 18,00,000 per yearGreetings for the DayScouting for a Director, Data Engineering Lead to be associated with a Global Digital Media Agency.Location: PuneShift: EMEARole & responsibilitiesDirector, Data Engineering Lead, you will drive the architecture, design, and implementation of enterprise-scale data platforms and pipelines. You will lead a high-performing team of data...
-
Lead Software Engineer
1 week ago
Pune, Maharashtra, India Data Direct Networks Full time ₹ 20,00,000 - ₹ 25,00,000 per yearOverviewThis is an incredible opportunity to be part of a company that has been at the forefront of AI and high-performance data storage innovation for over two decades. DataDirect Networks (DDN) is a global market leader renowned for powering many of the world's most demanding AI data centers, in industries ranging from life sciences and healthcare to...
-
Lead Data Engineer
2 weeks ago
Pune, Maharashtra, India Shashwath Solution Full time ₹ 20,00,000 - ₹ 25,00,000 per yearWe are seeking a skilled Lead Data Engineer with extensive experience in Snowflake, ADF, SQL, and other relevant data technologies to join our team. As a key member of our data engineering team, you will play an instrumental role in designing, developing, and managing data pipelines, working closely with cross-functional teams to drive the success of our...
-
Data Engineering Lead
3 days ago
Pune, Maharashtra, India Persistent Systems Full time ₹ 20,00,000 - ₹ 25,00,000 per yearAbout Position:We are seeking Data Engineering Lead with hands scrum, product owner, etc.,Role: Data Engineering LeadLocation: All Persistent LocationsExperience: 10 to 12 yearsJob Type: Full Time EmploymentWhat You'll Do:Define and execute the product vision and roadmap for the Compliance Insights platform.Collaborate with cross-functional teams to align...
-
Lead Data Engineer –Azure
3 days ago
Pune, Maharashtra, India Admin Looks Full time ₹ 12,00,000 - ₹ 36,00,000 per yearUrgently looking for highly experienced Lead Data Engineer with a proven track record in Azure data technologies and team leadership. The ideal candidate will have 12+ years of experience, including 7+ years of expertise in Azure Data Factory, Azure Databricks, Data Modeling, PySpark, SQL Queries, and Unity Catalog. This is a remote role requiring excellent...
-
Data Engineering Lead
6 days ago
Pune, Maharashtra, India Calfus Inc. Full time ₹ 12,00,000 - ₹ 36,00,000 per yearAbout Us:At Calfus, we are known for delivering cutting-edge AI agents and products that transform businesses in ways previously unimaginable. We empower companies to harness the full potential of AI, unlocking opportunities they never imagined possible before the AI era. Our software engineering teams are highly valued by customers, whether start-ups or...
-
Lead Data Engineer
5 hours ago
Pune, Maharashtra, India, Maharashtra Searce Inc Full timeWho we are?Searce means ‘a fine sieve’ & indicates ‘to refine, to analyze, to improve’. It signifies our way of working: To improve to the finest degree of excellence, ‘solving for better’ every time. Searcians are passionate improvers & solvers who love to question the status quo.The primary purpose of all of us, at Searce, is driving...
-
Lead Data Engineer
5 hours ago
Pune, Maharashtra, India, Maharashtra EXL Full timeAbout the RoleWe are seeking a highly skilled Lead Data Engineer to drive end-to-end data engineering initiatives, lead cross-functional teams, and deliver scalable, cloud-based data solutions. The ideal candidate will bring deep technical expertise, strong leadership, and the ability to collaborate effectively with global stakeholders in a fast-paced...