Senior ETL Developer

2 days ago

Rajkot, Gujarat, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000
Job Title

We are seeking a seasoned Data Engineer to join our team in developing and maintaining ETL processes. The successful candidate will work closely with data engineers, data scientists, and business intelligence teams to build and optimize data workflows that support the project's analytics and reporting needs.

  • Design and develop ETL processes using Databricks PySpark to extract, transform, and load data from heterogeneous sources into our data lake and data warehouse.
Responsibilities:

1. ETL Development:

  • Optimize ETL workflows for performance and scalability, leveraging Databricks PySpark and Spark SQL to efficiently process large data volumes.
  • Implement robust error handling and monitoring mechanisms to proactively detect and resolve issues within ETL processes.
  • Design and implement data solutions following the Medallion Architecture principles, organizing data into Bronze, Silver, and Gold layers.
  • Ensure data is appropriately cleansed, enriched, and optimized at each stage to support robust analytics and reporting.

2. Data Pipeline Management:

  • Hands On experience in creating advanced data pipelines using databricks workflows
  • Develop and maintain data pipelines using Databricks PySpark, ensuring data quality, integrity, and reliability throughout the ETL lifecycle.
  • Collaborate with data engineering, data science, and business intelligence teams to translate data requirements into efficient ETL workflows and pipelines.

3. Query Optimization:

  • Write and optimize complex SQL queries for data manipulation, aggregation, and analysis within Databricks PySpark applications.
Requirements:

1. Education:

  • Bachelor's degree in Computer Science, Engineering, or a related field.

2. Experience:

  • Minimum of 3 years of experience as an ETL developer, with a strong focus on Databricks PySpark development.

3. Skills:

  • Proficiency in Python programming, with extensive experience in developing and debugging Databricks PySpark applications.
  • In-depth understanding of Spark architecture and internals, with hands-on experience in Spark RDDs, DataFrames, and Spark SQL.
  • Expertise in writing and optimizing complex SQL queries for data manipulation, aggregation, and analysis.

4. Soft Skills:

  • Strong problem-solving skills and the ability to troubleshoot and resolve ETL process issues.
  • Excellent communication and collaboration skills, with the ability to work effectively in a team environment.

  • Senior ETL Developer

    24 hours ago

    Rajkot, Gujarat, India beBeeETLDATA Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Senior ETL DeveloperAs a senior ETL developer, you will be responsible for designing, developing, and testing ETL architecture, transformation jobs, and workflow schedules.The ideal candidate should have expertise in Hive, Spark, big data technologies, SQL (advanced scripting and optimization), data warehousing principles, and dimensional...

  • Talend ETL Development Specialist

    4 days ago

    Rajkot, Gujarat, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    We are seeking a skilled professional to take on the role of a Talend ETL Developer with expertise in data integration and processing.Job Description:Talend ETL Developers design, develop, and implement data pipelines using Talend Open Studio. This involves extracting data from various sources, transforming it into a usable format, and loading it into target...

  • Full-Time ETL Developer Position

    2 days ago

    Rajkot, Gujarat, India beBeeInformatica Full time ₹ 20,00,000 - ₹ 30,00,000

    Key responsibilities of this full-time ETL Developer role include designing, developing and testing ETL architecture, transformation jobs and workflow schedules using Informatica BDM/DEI.The ideal candidate should have 5+ years of experience in Informatica BDM/DEI and Telecom (Telco) domain. Key skills required are Informatica BDM/DEI, ETL pipeline design...

  • Senior ETL Specialist

    6 days ago

    Rajkot, Gujarat, India beBeeDataIntegrationDeveloper Full time ₹ 17,50,000 - ₹ 22,50,000

    Job Summary:We are seeking a skilled Data Integration Developer to design, develop, and deploy SSIS packages for complex ETL workflows.Design and Develop Advanced Data PipelinesCreate and Optimize Enterprise Reporting SolutionsWrite Efficient SQL QueriesTroubleshoot Performance BottlenecksYou will work closely with cross-functional teams in an Agile/Kanban...

  • ETL LEAD with IBM DataStage experienced

    7 days ago

    Rajkot, Gujarat, India IntraEdge Full time

    Job Title: ETL Developer – DataStage, AWS, SnowflakeExperience: 5–7 YearsLocation: RemoteJob Type: Full-timeAbout the RoleWe are looking for a talented and motivated ETL Developer / Senior Developer to join our data engineering team. You will work on building scalable and efficient data pipelines using IBM DataStage (on Cloud Pak for Data), AWS Glue, and...

  • Lead ETL Data Specialist

    2 days ago

    Rajkot, Gujarat, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    About the Role:We are seeking a skilled ETL Tester to join our team. As an ETL and Power BI Tester, you will be responsible for ensuring the accuracy, integrity, and performance of ETL Pipelines deployed into Azure cloud environments.Key Responsibilities:Design and develop comprehensive test cases for Azure Data Factory ETL pipelines using python and...

  • Senior Business Intelligence Specialist

    4 days ago

    Rajkot, Gujarat, India beBeeDataEngineer Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Job Role OverviewOur organization is seeking a skilled Senior Data Engineer to contribute to its data engineering team.Key Responsibilities:ETL Pipeline Development: Design and implement efficient ETL pipelines using FiveTran, DBT Cloud, and custom frameworks to streamline data extraction, transformation, and loading processes.Data Transformations: Implement...

  • Senior Developer Architect

    2 days ago

    Rajkot, Gujarat, India beBeeTechnical Full time US$ 1,25,000 - US$ 1,75,000

    Job Title: Technical LeadAs a senior developer and architect, you will be responsible for leading the development and integration of Python-based applications with Large Language Models (LLMs).Key Responsibilities:Design and implement LLM pipelines including prompt engineering, retrieval-augmented generation (RAG), fine-tuning, and evaluation.Develop...

  • Senior Business Intelligence Developer

    4 days ago

    Rajkot, Gujarat, India beBeeData Full time ₹ 12,00,000 - ₹ 20,00,000

    Job Title:Data AnalystAbout the Role:We are seeking a skilled Data Analyst with strong expertise in both Java and Python programming. This role combines traditional data analysis with programming-driven problem-solving to deliver meaningful business insights.The ideal candidate will be responsible for data extraction, transformation, analysis, and reporting...

  • Senior Data Integration Specialist

    1 day ago

    Rajkot, Gujarat, India beBeeETL Full time ₹ 12,10,000 - ₹ 20,19,000

    Job SummaryWe are seeking a highly skilled ETL Developer to fulfill our data integration and business intelligence needs. The ideal candidate will be responsible for designing, developing, and maintaining ETL processes, as well as data warehouse design and modeling.This role requires proficiency in T-SQL, Azure Data Factory (ADF), and SSIS, along with...