Senior ETL Developer with Data Engineering Expertise

3 days ago

Vellore, Tamil Nadu, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

**Job Description**

A talented and motivated ETL Developer/Senior Developer is sought to join our data engineering team. The successful candidate will work on building scalable and efficient data pipelines using IBM DataStage (on Cloud Pak for Data), AWS Glue, and Snowflake.

The ideal candidate will collaborate with architects, business analysts, and data modelers to ensure timely and accurate delivery of critical data assets supporting analytics and AI/ML use cases.

  • Key Responsibilities:
  • Design, develop, and maintain ETL pipelines using IBM DataStage (CP4D) and AWS Glue/Lambda for ingestion from varied sources like flat files, APIs, Oracle, DB2, etc.
  • Build and optimize data flows for loading curated datasets into Snowflake, leveraging best practices for schema design, partitioning, and transformation logic.
  • Participate in code reviews, performance tuning, and defect triage sessions.
  • Work closely with data governance teams to ensure lineage, privacy tagging, and quality controls are embedded within pipelines.
  • Contribute to CI/CD integration of ETL components using Git, Jenkins, and parameterized job configurations.
  • Troubleshoot and resolve issues in QA/UAT/Production environments as needed.
  • Adhere to agile delivery practices, sprint planning, and documentation requirements.

**Required Skills and Qualifications**

  • At least 4 years of experience in ETL development with at least 1–2 years in IBM DataStage (preferably CP4D version).
  • Hands-on experience with AWS Glue (PySpark or Spark) and AWS Lambda for event-based processing.
  • Experience working with Snowflake: loading strategies, stream-task, zero-copy cloning, and performance tuning.
  • Proficiency in SQL, Unix scripting, and basic Python for data handling or automation.
  • Familiarity with S3, version control systems (Git), and job orchestration tools.
  • Experience with data profiling, cleansing, and quality validation routines.
  • Understanding of data lake/data warehouse architectures and DevOps practices.

**Good to Have**

  • Experience with Collibra, BigID, or other metadata/governance tools.
  • Exposure to Data Mesh/Data Domain models.
  • Experience with agile/Scrum delivery and Jira/Confluence tools.
  • AWS or Snowflake certification is a plus.

  • Senior ETL Automation Engineer

    1 day ago

    Vellore, Tamil Nadu, India beBeeData Full time ₹ 12,00,000 - ₹ 25,00,000

    About People Prime Worldwide :We are a leader in business transformation, leveraging technology to address a wide range of business needs. We are committed to unleashing human energy through technology for an inclusive and sustainable future.We provide various services including consulting, technology, professional, and outsourcing services.Job...

  • Data Engineer

    1 day ago

    Vellore, Tamil Nadu, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Data Engineer - Oil and Gas Expertise Job Summary: We are seeking an experienced Data Engineer with oil and gas industry expertise to design, build, and optimize scalable data pipelines and cloud solutions. The ideal candidate will have strong experience in AWS cloud services, data engineering, and knowledge of oil and gas upstream, midstream, or...

  • Senior Data Engineering Specialist

    3 days ago

    Vellore, Tamil Nadu, India beBeeDataScientist Full time ₹ 15,00,000 - ₹ 26,25,000

    Job Title: Senior Big Data EngineerWe are seeking a highly skilled data analyst with expertise in SQL, Python, and Java.The ideal candidate will play a critical role in data extraction, integration, and advanced analysis by leveraging traditional programming and emerging AI technologies.Key Responsibilities:Design, develop, and optimize SQL queries for data...

  • Data Engineer

    3 weeks ago

    Vellore, Tamil Nadu, India Marktine Technology Solutions Pvt Ltd Full time

    Position: Senior Data EngineerExp: 12-15 YearsLocation: RemoteWe are seeking a Senior Data Engineer. The ideal candidate will be based in India and work remotely. This role requires a blend of design and implementation expertise.Key Responsibilities:Design and bootstrap data solutions, including setting up Snowflake for a large, complex conglomerate.Utilize...

  • Data Engineering Specialist

    3 days ago

    Vellore, Tamil Nadu, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job OverviewWe are seeking a highly skilled professional to design and develop efficient ETL pipelines using FiveTran, DBT Cloud, and custom frameworks.Key ResponsibilitiesETL Pipeline Development: Develop scalable and maintainable ETL pipelines to ensure seamless data integration.Data Transformation: Implement client-specific data transformations for...

  • Chief Data Architect

    2 days ago

    Vellore, Tamil Nadu, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Senior Data Engineer PositionWe are seeking a seasoned Senior Data Engineer to design and optimize data solutions for our leading financial customers. This role requires deep expertise in ETL development, data modeling, and financial data domains, particularly within credit unions and banking systems.

  • Data Engineering Specialist

    1 day ago

    Vellore, Tamil Nadu, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Data Engineering Specialist">We are seeking a highly skilled data engineering specialist to join our team. As a key member of our data platform implementation team, you will be instrumental in designing, developing, and maintaining efficient extraction, transformation, and loading (ETL) processes for large-scale data warehousing.">The successful...

  • Senior Data Developer

    1 day ago

    Vellore, Tamil Nadu, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Data Engineering Opportunity The Data Engineer will design and implement data pipelines to extract, transform, and load data from various sources into a data warehouse. This role requires strong knowledge of ETL tools and SQL, as well as experience with data warehousing and modeling concepts.About the RoleCollaborate with cross-functional teams to ensure...

  • Senior Data Architect

    5 days ago

    Vellore, Tamil Nadu, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Senior Data ArchitectA leading organization is seeking a skilled Senior Data Architect to spearhead the design and implementation of its data architecture. This is an exciting opportunity for an experienced professional to leverage their expertise in data engineering and lead the development of innovative data solutions.Key...

  • Data Engineering Expert

    15 hours ago

    Vellore, Tamil Nadu, India beBeeDataEngineer Full time ₹ 16,00,000 - ₹ 2,02,50,000

    About This RoleWe're looking for a skilled professional to drive our data engineering efforts forward.This role is focused on developing and implementing modern data warehouse solutions using Snowflake and ADF, as well as providing forward-thinking solutions in the data engineering and analytics space.The ideal candidate will have expertise in Snowflake...