Lead Data Engineer

2 weeks ago

Pune, Maharashtra, India Principal Global Services Full time ₹ 12,00,000 - ₹ 36,00,000 per year

Responsibilities:

  • Job Description

Looking for a highly skilled and experienced Lead Data Engineer to join our growing Data & Analytics IT team. The ideal candidate will be responsible for expanding, optimizing, and meticulously maintaining our data pipeline architecture. This position involves working closely with cross functional teams, including data source teams, data consumers, SME's, to ensure smooth data flow, efficient data collection, and data product development. The focus will be on re-engineering our data architecture, ensuring it aligns with the organization architectural guiding principles and support our next-generation data initiatives.

Roles and Responsibility

  • Possesses 6-10 years of experience in developing and architecting with AWS, Snowflake data engineering solutions.
  • Design, build and operationalize large scale enterprise data solutions and applications using AWS services like S3, Glue, Lambda, SNS, EC2, IAM & KMS, and Snowflake (snowpipe, streams, tasks stored procedures)
  • Should be able to collaborate with analytics partners to gather requirements, propose the best cloud solutions and implement them effectively.
  • Follow established project execution processes, coding standards, and industry best practices.
  • Should be aware about AWS, Snowflake and Data security principles.
  • Get actively involved in Training, self-development & knowledge sharing activities. Contribute actively to organization-level cloud initiatives.
  • Problem solver with analytical thinking and ability to apply root cause analysis.
  • Demonstrate a good learning attitude to quickly master new services/technologies and adapt to working both independently and collaboratively.
  • Focus on continuously improving solutions and personal development.
  • Possess excellent communication and collaboration skills, with the ability to communicate important and relevant information concisely and clearly.

Qualifications:

  • Skills set:

  • 6-10 years of experience in data engineering with 4-6 years in lead role.

  • Proficiency in BI, Python, SQL, and working with relational databases.
  • Proven experience in building and optimizing data pipelines, architectures, and data sets.
  • Experience with CI/CD Pipelines in GitHub and Jenkins
  • Strong communication and collaboration skills

Must have Skills:

Extensive experience with AWS services: S3, Glue, Lambda, SNS, EC2, IAM and KMS

Proficiency in CI/CD Pipelines in GitHub, and Snowflake features like streams, tasks, stored procedures, snowpipe and data sharing.

Good to have Skills:

Hands on experience/Familiarity with one/more of the following technologies: Database, Data Visualization (Power BI), Scripting, ETL (Informatica PowerCenter), understand data mesh architectures. Nice to have Cloud certifications in AWS, Snowflake.

Additional Information:

We are looking for a passionate Lead Data Engineer who is self-driven, takes ownership of their work, and is committed to building high-quality, scalable data solutions. If you are ready to lead and innovate in a dynamic environment, we'd love to hear from you

  • Data Engineer

    6 days ago

    Pune, Maharashtra, India Data Axle Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    About Data Axle:Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and leveraging proprietary...

  • Data Engineer

    1 week ago

    Pune, Maharashtra, India Jash Data Sciences Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Do you love solving real-world data problems with the latest and best techniques? And having fun while solving them in a team Then come join our high-energy team of passionate data people. Jash Data Sciences is the right place for you.We are a cutting-edge Data Sciences and Data Engineering startup based in Pune, India.We believe in continuous learning and...

  • Lead Data Engineer

    1 week ago

    Pune, Maharashtra, India Rearc Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    About RearcFounded in 2016, we pride ourselves on fostering an environment where creativity flourishes, bureaucracy is non-existent, and individuals are encouraged to challenge the status quo. We're not just a company; we're a community of problem-solvers dedicated to improving the lives of fellow software engineers.Our commitment is simple - finding the...

  • Lead Data Engineer

    6 days ago

    Pune, Maharashtra, India North Hires Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Company DescriptionNorth Hires is a premier consulting firm specializing in Custom Software Development, Recruitment, Sourcing, and Executive Search services. Our mission is to empower businesses by providing them with the finest human capital. We strive to be the go-to consulting partner for companies seeking exceptional talent, fostering growth,...

  • Lead Software Engineer

    2 weeks ago

    Pune, Maharashtra, India Data Direct Networks Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Overview This is an incredible opportunity to be part of a company that has been at the forefront of AI and high-performance data storage innovation for over two decades. DataDirect Networks (DDN) is a global market leader renowned for powering many of the world's most demanding AI data centers, in industries ranging from life sciences and healthcare to...

  • Lead Data Engineer

    1 week ago

    Pune, Maharashtra, India Arting Digital Private Limited Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Posting title: Lead Data Engineer (Databricks)Experience: 7+ YearsLocation: Pune/ AhmedabadWork mode: HybridPrimary skills: Databricks, Data Modelling/ Data Lakehouse, Gen AI, SQL, Python/Scala, Azure Data Factory (ADF)/AWS Glue, Docker, Team LeadQualification: Any Technical DegreeRoles & Responsibilities:Lead the design, development, and optimization of...

  • Data Operations Engineer

    1 week ago

    Pune, Maharashtra, India Mars Data Insights Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Title: Data Operations Engineer & RUN SupportSkills:Data Operations Engineering, data manipulation, Python, Talend, GCP, Bigquery, DataIku, ITSM/ticketing tools, Helix, Jira, task management, data pipelines,  RUN Service, data infrastructure, data quality Job Location:Pune Job Type:Fulltime/Hybrid Work Experience:5+ years We are seeking a highly...

  • Lead Data Engineer

    6 days ago

    Pune, Maharashtra, India Arting Digital Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Posting title :Lead Data Engineer (Databricks)Experience :7+ YearsLocation :Pune/ AhmedabadWork mode :HybridPrimary skills :Databricks, Data Modelling/ Data Lakehouse, Gen AI, SQL, Python/Scala, Azure Data Factory (ADF)/AWS Glue, Docker, Team LeadQualification :Any Technical DegreeRoles & ResponsibilitiesLead the design, development, and optimization of data...

  • Lead Data Engineer

    1 week ago

    Pune, Maharashtra, India Principal Global Services Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    ResponsibilitiesJob DescriptionLooking for a highly skilled and experienced Lead Data Engineer to join our growing Data & Analytics IT team. The ideal candidate will be responsible for expanding, optimizing, and meticulously maintaining our data pipeline architecture. This position involves working closely with cross functional teams, including data source...

  • Lead Software Engineer

    1 week ago

    Pune, Maharashtra, India Data Direct Networks Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    OverviewThis is an incredible opportunity to be part of a company that has been at the forefront of AI and high-performance data storage innovation for over two decades. DataDirect Networks (DDN) is a global market leader renowned for powering many of the world's most demanding AI data centers, in industries ranging from life sciences and healthcare to...