Lead Data Engineer

7 days ago

Pune Maharashtra India, Maharashtra ITQube LTD Full time
  • Looking for a Data Engineer to join our engineering will contribute directly to the design, automation, and optimization of our data processes, primarily developing solutions in Python within the AWS cloud ecosystem, including Lambda, Glue, Redshift, and other key services.
  • The role also involves working with infrastructure as code (Terraform), Git-based version control, and designing scalable data architectures. The ideal candidate has solid data engineering knowledge, a passion for automation, experience working with large volumes of data, and the ability to proactively propose technical and architectural improvements. Responsibilities:
  • Design, develop, and maintain efficient ETL processes using Python, SQL, AWS Glue, and Redshift.
  • Automate data flows and integrations using AWS Lambda and other serverless services. Propose improvements and optimizations to existing pipelines, prioritizing performance, scalability, and maintainability.
  • Collaborate on the design of scalable and resilient data architectures in AWS.
  • Develop and manage infrastructure as code using Terraform.
  • Actively participate in code reviews and collaborative version control workflows using Git.
  • Document technical solutions and promote best practices in data engineering.
  • Ensure that data processing pipelines can handle large-scale datasets (Big Data). Who we’re looking for: Technical Requirements:
  • Programming Languages: Python – 3+ years of experience (Intermediate to advanced level) o SQL – 3+ years of experience, capable of working with complex data models
  • Large-scale data processing:
  • Experience with PySpark or Big Data environments – 1–2+ years (preferred)
  • Familiarity with distributed processing and performance optimization for high-volume data pipelines
  • AWS Technologies: Lambda, Glue, Redshift, S3 – 2–3 years of hands-on experience
  • Experience designing ETL workflows using native AWS services
  • Proactive mindset with a drive to propose and implement improvements
  • Analytical thinker with the ability to identify bottlenecks and performance issues.
  • Effective collaborator with both technical teams and non-technical stakeholders
  • Strong documentation and technical communication skills Nice to have (not mandatory):
  • Experience with monitoring and observability tools for data pipelines (CloudWatch, logging, alerting), Knowledge of event-driven architecture design
  • Familiarity with orchestration tools like Apache
  • Experience with automated testing for data pipelines
  • Background in Fintech or experience handling financial datasets

  • Lead Data Engineer

    7 days ago

    Pune, Maharashtra, India, Maharashtra ACL Digital Full time

    Experience:- 10 years to 13 years.- Location: Pune,Bangalore,ChennaiNotice Period:- Immediate Joiner onlyMandatory Key Skills:-6 years relevant in Data Engineering.Experience in AWS.Experience in Python & pyspark.Experience in ETL Development, ETL pipeline.Experience in Data Modelling & Data Pipeline.Experience in Database.Experience in working as Individual...

  • Data Engineer

    1 week ago

    Pune, Maharashtra, India Data Axle Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    About Data Axle:Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and leveraging proprietary...

  • Data Engineer

    2 weeks ago

    Pune, Maharashtra, India Jash Data Sciences Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Do you love solving real-world data problems with the latest and best techniques? And having fun while solving them in a team Then come join our high-energy team of passionate data people. Jash Data Sciences is the right place for you.We are a cutting-edge Data Sciences and Data Engineering startup based in Pune, India.We believe in continuous learning and...

  • Lead Aws Data Engineer

    7 days ago

    Pune, Maharashtra, India, Maharashtra ACL Digital Full time

    Lead Data Engineer7+ yrs expLocation: Balewadi, PuneImmediate joiners only.ResponsibilitiesMulti-year work experience as a Platform Lead, Delivery Leader or similar role.Good working knowledge of Aws Services, Python, Pyspark, data modelling.Knowledge of columnar and NoSQL databases, predictive analytics, data visualization, and unstructured data.Knowledge...

  • Lead Data Scientist

    7 days ago

    Pune, Maharashtra, India, Maharashtra Fulcrum Digital Inc Full time

    We are looking for a highly experienced Data Scientist to lead data-driven initiatives and deliver scalable machine learning solutions to complex business problems. The ideal candidate will combine technical depth in ML/AI with strong business acumen, driving impact through advanced analytics, feature engineering, and model deployment.Key...

  • Google Cloud Data Engineering Lead

    7 days ago

    Pune, Maharashtra, India, Maharashtra HSBC Full time

    Engineer the data transformations and analysis for the Cash Equities Trading platform.Technology SME on the real-time stream processing paradigm.Bring your experience in Low latency, High through-put, auto scaling platform design and implementation.Implementing an end-to-end platform service, assessing the operations and non-functional needs clearly.Mentor...

  • Lead Data Engineer

    2 weeks ago

    Pune, Maharashtra, India Rearc Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    About RearcFounded in 2016, we pride ourselves on fostering an environment where creativity flourishes, bureaucracy is non-existent, and individuals are encouraged to challenge the status quo. We're not just a company; we're a community of problem-solvers dedicated to improving the lives of fellow software engineers.Our commitment is simple - finding the...

  • Lead Data Engineer

    1 week ago

    Pune, Maharashtra, India North Hires Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Company DescriptionNorth Hires is a premier consulting firm specializing in Custom Software Development, Recruitment, Sourcing, and Executive Search services. Our mission is to empower businesses by providing them with the finest human capital. We strive to be the go-to consulting partner for companies seeking exceptional talent, fostering growth,...

  • Data Engineer Lead

    2 days ago

    Pune, Maharashtra, India Mappy Global Resources Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Greetings for the DayScouting for a Director, Data Engineering Lead to be associated with a Global Digital Media Agency.Location: PuneShift: EMEARole & responsibilitiesDirector, Data Engineering Lead, you will drive the architecture, design, and implementation of enterprise-scale data platforms and pipelines. You will lead a high-performing team of data...

  • Lead Software Engineer

    7 hours ago

    Pune, Maharashtra, India Data Direct Networks Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    OverviewThis is an incredible opportunity to be part of a company that has been at the forefront of AI and high-performance data storage innovation for over two decades. DataDirect Networks (DDN) is a global market leader renowned for powering many of the world's most demanding AI data centers, in industries ranging from life sciences and healthcare to...