Senior ETL Developer

1 week ago

hyderabad, India Milestone Technologies, Inc. Full time

We are looking for a Senior ETL Developer. This pivotal role is dedicated to harnessing state-of-the-art data processing technologies such as Snowpark, Snow pipe, Apache Spark, and Databricks Delta Live Tables. The successful candidate will play a key role in evolving, deploying, and overseeing our advanced data infrastructure, pivotal for extensive data processing, analytics, and business intelligence functions. Demonstrating profound knowledge in cloud-native tools and platforms including AWS, Azure, Oracle, Snowflake, and Databricks, the Senior Data Engineer will also excel in deploying advanced data integration techniques utilizing cloud-native ETL tools (e.g., AWS Glue, Azure Data Factory) and Oracle Data Integrator (ODI).

Key Responsibilities:

  • Lead the architecture and development of scalable data solutions across both batch and streaming platforms, optimizing the use of cloud technologies (AWS or similar) to meet business and technical demands, including real-time data processing.
  • Analyze complex data elements and systems, engaging in the development of conceptual, logical, and physical data models, along with the validation and execution of ETL/ELT mappings and transformation logic.
  • Craft and peer review data models and schemas, enhancing new and current data sources for the data warehouse, ensuring efficiency and scalability.
  • Conduct thorough unit, integration, and system testing of data sources to ensure data integrity against source systems, aiming for continuous performance optimization.
  • Innovate with Snowflake’s Snowpark and Snowpipe to architect scalable data management solutions, facilitating real-time data ingestion.
  • Leverage Apache Spark for comprehensive data processing and analytics, enhancing data workflow efficiency and scalability.
  • Implement Databricks Delta Live Tables to automate and ensure data ETL processes, maintaining data quality and consistency for real-time analytics.
  • Maintain high-performance data pipelines, making extensive use of AWS, Azure, and Databricks, along with seamless integration with Oracle Data Integrator (ODI).
  • Utilize cloud native ETL tools to streamline data integration and transformation across diverse data platforms.
  • Develop sophisticated data transformations and machine learning models within Snowflake using Snowpark to boost analytics capabilities.
  • Ensure the availability of real-time data and analytics through efficient configuration and optimization of Snowpipe.
  • Collaborate with business stakeholders and IT departments to transform business needs into technical specifications and practical data models.
  • Uphold data governance, security, and compliance standards across all data platforms and tools.
  • Remain abreast of emerging trends and technologies in data engineering, promoting innovative solutions that propel the data strategy.

Qualifications:

  • Bachelor’s or master’s degree in computer science, Information Technology, Engineering, or a related field.
  • 3-5 years of proven expertise in data processing and analytics using Apache Spark, with hands-on experience in Databricks Delta Live Tables for managing real-time data.
  • Proficiency in Snowflake, including mastery of Snowpark and Snowpipe, paired with experience in cloud native ETL tools (AWS Glue, Azure Data Factory, Google Cloud Dataflow).
  • Comprehensive background in Oracle, Snowflake, Databricks, and Oracle Data Integrator (ODI) for in-depth data integration and processing.
  • Strong programming skills in SQL, Python, Java, or Scala, with the capability to develop intricate data models and algorithms.
  • In-depth knowledge of data warehousing, data modeling, and data lake concepts within a cloud environment.
  • Exceptional problem-solving skills, complemented by the ability to work both independently and collaboratively.
  • Outstanding communication skills, with proficiency in engaging with both technical and non-technical team members.

  • Senior ETL Developer

    2 weeks ago

    Hyderabad, Telangana, India Medtronic Full time

    Job Title: Senior ETL DeveloperThe Senior ETL Developer will be responsible for performing ETL development work for the Business Intelligence group of Global Applications.

  • Senior ETL Developer

    7 days ago

    Hyderabad, Telangana, India Pragati Finserv pvt Lt Full time

    **Job Title:** Senior ETL Developer**Job Description:**At Pragati Finserv pvt Ltd, we are seeking a highly skilled Senior ETL Developer to join our team. As a key member of our data warehousing team, you will be responsible for designing, developing, and maintaining our ETL architecture.Design and implement ETL processes to extract, transform, and load data...

  • Senior ETL Developer

    6 days ago

    Hyderabad, Telangana, India Risk Resources LLP Full time

    Overview:The Senior ETL Developer plays a key role in Risk Resources LLP\'s data management strategy. As a member of the data management team, the successful candidate will be responsible for designing, developing, and implementing ETL solutions using Talend. The primary focus will be on ensuring the accuracy, completeness, and availability of data for...

  • Senior ETL Developer

    2 weeks ago

    Hyderabad, Telangana, India Pragati Finserv pvt Lt Full time

    Job Description:We are seeking an experienced Senior ETL Developer to join our team at Pragati Finserv pvt Lt.Key Responsibilities:Design and implement ETL processes to extract, transform, and load data into the data warehouse.Develop and maintain complex ETL mappings and workflows using RDBMS, flat file, XML File, and JSON.Analyze data to identify trends...

  • Senior ETL Developer

    7 days ago

    Hyderabad, India Milestone Technologies, Inc. Full time

    We are looking for a SeniorETL Developer . This pivotal role is dedicated to harnessing state-of-the-art data processing technologies such as Snowpark, Snow pipe, Apache Spark, and Databricks Delta Live Tables. The successful candidate will play a key role in evolving, deploying, and overseeing our advanced data infrastructure, pivotal for extensive data...

  • Senior ETL Developer

    2 days ago

    hyderabad, India Milestone Technologies, Inc. Full time

    We are looking for a Senior ETL Developer. This pivotal role is dedicated to harnessing state-of-the-art data processing technologies such as Snowpark, Snow pipe, Apache Spark, and Databricks Delta Live Tables. The successful candidate will play a key role in evolving, deploying, and overseeing our advanced data infrastructure, pivotal for extensive data...

  • Senior ETL Developer

    5 days ago

    Hyderabad, India Milestone Technologies, Inc. Full time

    We are looking for a Senior ETL Developer. This pivotal role is dedicated to harnessing state-of-the-art data processing technologies such as Snowpark, Snow pipe, Apache Spark, and Databricks Delta Live Tables. The successful candidate will play a key role in evolving, deploying, and overseeing our advanced data infrastructure, pivotal for extensive data...

  • Senior ETL Developer

    7 days ago

    hyderabad, India Milestone Technologies, Inc. Full time

    We are looking for a Senior ETL Developer . This pivotal role is dedicated to harnessing state-of-the-art data processing technologies such as Snowpark, Snow pipe, Apache Spark, and Databricks Delta Live Tables. The successful candidate will play a key role in evolving, deploying, and overseeing our advanced data infrastructure, pivotal for extensive data...

  • Senior etl developer

    1 week ago

    Hyderabad, India Milestone Technologies, Inc. Full time

    We are looking for a Senior ETL Developer. This pivotal role is dedicated to harnessing state-of-the-art data processing technologies such as Snowpark, Snow pipe, Apache Spark, and Databricks Delta Live Tables. The successful candidate will play a key role in evolving, deploying, and overseeing our advanced data infrastructure, pivotal for extensive data...

  • Senior ETL SSIS Developer

    2 weeks ago

    Hyderabad, Telangana, India Virtusa Full time

    Job Title: Senior ETL SSIS DeveloperJob Summary:We are seeking a highly skilled Senior ETL SSIS Developer to join our team at Virtusa. As a key member of our data integration team, you will be responsible for designing, implementing, and maintaining scalable, secure, and cost-effective cloud solutions using AWS services.Key Responsibilities:Translate...

  • Senior ETL Developer

    1 week ago

    Hyderabad, India Milestone Technologies, Inc. Full time

    We are looking for a Senior ETL Developer. This pivotal role is dedicated to harnessing state-of-the-art data processing technologies such as Snowpark, Snow pipe, Apache Spark, and Databricks Delta Live Tables. The successful candidate will play a key role in evolving, deploying, and overseeing our advanced data infrastructure, pivotal for extensive data...

  • Senior ETL Developer

    7 days ago

    Hyderabad, India Milestone Technologies, Inc. Full time

    We are looking for a Senior ETL Developer . This pivotal role is dedicated to harnessing state-of-the-art data processing technologies such as Snowpark, Snow pipe, Apache Spark, and Databricks Delta Live Tables. The successful candidate will play a key role in evolving, deploying, and overseeing our advanced data infrastructure, pivotal for extensive data...

  • Senior ETL Developer

    1 week ago

    Hyderabad, India Milestone Technologies, Inc. Full time

    We are looking for a Senior ETL Developer. This pivotal role is dedicated to harnessing state-of-the-art data processing technologies such as Snowpark, Snow pipe, Apache Spark, and Databricks Delta Live Tables. The successful candidate will play a key role in evolving, deploying, and overseeing our advanced data infrastructure, pivotal for extensive data...

  • Senior ETL SSIS Developer

    3 weeks ago

    Hyderabad, Telangana, India Virtusa Full time

    Job Title: Senior ETL SSIS DeveloperJob Summary:We are seeking a highly skilled Senior ETL SSIS Developer to join our team at Virtusa. The ideal candidate will have extensive experience in designing and implementing scalable, secure, and cost-effective cloud solutions using AWS services.Key Responsibilities: Translate stakeholders' requirements into...

  • Senior ETL Tester

    4 weeks ago

    Hyderabad, India ILink Digital Full time

    Job Title: Senior ETL TesterJob Summary:We are seeking a highly skilled Senior ETL Tester to join our team at ILink Digital. The ideal candidate will have extensive experience in data testing, ETL processes, and data validation.Key Responsibilities:Develop and execute comprehensive test plans for ETL processesCollaborate with data engineers to optimize ETL...

  • Senior ETL Tester

    4 weeks ago

    Hyderabad, India ILink Digital Full time

    Job Title: Senior ETL TesterAbout the Role:We are seeking a highly skilled Senior ETL Tester to join our team at ILink Digital. As a Senior ETL Tester, you will be responsible for leading the creation of comprehensive test plans and strategies for ETL processes, developing automated test scripts using Python to validate data pipelines, and ensuring data...

  • Senior ETL Developer

    3 weeks ago

    Hyderabad, Telangana, India Virtusa Full time

    Job Title: ETL SSIS Developer Job Summary: We are seeking an experienced ETL SSIS Developer to join our team at Virtusa. The successful candidate will have a strong background in ETL toolsets, particularly SSIS, and experience with Visual Studio. They will also have knowledge of database operational and basic admin tasks, as well as shell scripting. The...

  • Senior ETL Tester

    2 weeks ago

    Hyderabad, India ILink Digital Full time

    About the RoleILink Digital is seeking an experienced Senior ETL Tester to lead the creation of comprehensive test plans and strategies for ETL processes. The ideal candidate will have a strong background in data quality assurance, data pipelines, and test automation.Key Responsibilities:Develop automated test scripts using Python to validate data...

  • Senior ETL Developer

    2 weeks ago

    Hyderabad, Telangana, India PRUDENT GLOBALTECH SOLUTIONS PRIVATE LIMITED Full time

    Job OverviewPRUDENT GLOBALTECH SOLUTIONS PRIVATE LIMITED is seeking an experienced Data Systems Specialist to join our team in Hyderabad, Telangana, India. As a Data Systems Specialist, you will play a critical role in designing, building, and maintaining efficient, reliable, and scalable data systems.Key ResponsibilitiesDesign and implement ETL pipelines to...

  • Senior ETL Developer

    2 weeks ago

    Hyderabad, India Pragati Finserv pvt Lt Full time

    Job DescriptionUse Business Intelligence and Data warehousing concepts and methodologies for augmentingbusiness decisions.Define and deliver the ETL Architecture.An excellent communicator, he/ she would estimate efforts, prepare High and Low-level designdocuments and develop code within the agreed timelines.Interpret data, analyse results using statistical...