Etl lead

2 months ago

Hyderabad, India Milestone Technologies, Inc. Full time
Position Overview:
We are looking for Lead ETL Developer. This pivotal role is dedicated to harnessing state-of-the-art data processing technologies such as Snowpark, Snow pipe, Apache Spark, and Databricks Delta Live Tables. The successful candidate will play a key role in evolving, deploying, and overseeing our advanced data infrastructure, pivotal for extensive data processing, analytics, and business intelligence functions. Demonstrating profound knowledge in cloud-native tools and platforms including AWS, Azure, Oracle, Snowflake, and Databricks, the Senior Data Engineer will also excel in deploying advanced data integration techniques utilizing cloud-native ETL tools (e.g., AWS Glue, Azure Data Factory) and Oracle Data Integrator (ODI).
Key Responsibilities:
Lead the architecture and development of scalable data solutions across both batch and streaming platforms, optimizing the use of cloud technologies (AWS or similar) to meet business and technical demands, including real-time data processing.
Analyze complex data elements and systems, engaging in the development of conceptual, logical, and physical data models, along with the validation and execution of ETL/ELT mappings and transformation logic.
Craft and peer review data models and schemas, enhancing new and current data sources for the data warehouse, ensuring efficiency and scalability.
Conduct thorough unit, integration, and system testing of data sources to ensure data integrity against source systems, aiming for continuous performance optimization.
Innovate with Snowflake’s Snowpark and Snowpipe to architect scalable data management solutions, facilitating real-time data ingestion.
Leverage Apache Spark for comprehensive data processing and analytics, enhancing data workflow efficiency and scalability.
Implement Databricks Delta Live Tables to automate and ensure data ETL processes, maintaining data quality and consistency for real-time analytics.
Maintain high-performance data pipelines, making extensive use of AWS, Azure, and Databricks, along with seamless integration with Oracle Data Integrator (ODI).
Utilize cloud native ETL tools to streamline data integration and transformation across diverse data platforms.
Develop sophisticated data transformations and machine learning models within Snowflake using Snowpark to boost analytics capabilities.
Ensure the availability of real-time data and analytics through efficient configuration and optimization of Snowpipe.
Collaborate with business stakeholders and IT departments to transform business needs into technical specifications and practical data models.
Uphold data governance, security, and compliance standards across all data platforms and tools.
Remain abreast of emerging trends and technologies in data engineering, promoting innovative solutions that propel the data strategy.
Qualifications:
Bachelor’s or master’s degree in computer science, Information Technology, Engineering, or a related field.
Proven expertise in data processing and analytics using Apache Spark, with hands-on experience in Databricks Delta Live Tables for managing real-time data.
Proficiency in Snowflake, including mastery of Snowpark and Snowpipe, paired with experience in cloud native ETL tools (AWS Glue, Azure Data Factory, Google Cloud Dataflow).
Comprehensive background in Oracle, Snowflake, Databricks, and Oracle Data Integrator (ODI) for in-depth data integration and processing.
Strong programming skills in SQL, Python, Java, or Scala, with the capability to develop intricate data models and algorithms.
In-depth knowledge of data warehousing, data modeling, and data lake concepts within a cloud environment.
Exceptional problem-solving skills, complemented by the ability to work both independently and collaboratively.
Outstanding communication skills, with proficiency in engaging with both technical and non-technical team members.
Experience in managing and leading team

  • ETL Lead

    2 months ago

    Hyderabad, India Milestone Technologies, Inc. Full time

    Position Overview: We are looking for Lead ETL Developer. This pivotal role is dedicated to harnessing state-of-the-art data processing technologies such as Snowpark, Snow pipe, Apache Spark, and Databricks Delta Live Tables. The successful candidate will play a key role in evolving, deploying, and overseeing our advanced data infrastructure, pivotal for...

  • ETL Lead

    2 months ago

    Hyderabad, India Milestone Technologies, Inc. Full time

    Position Overview:We are looking for Lead ETL Developer. This pivotal role is dedicated to harnessing state-of-the-art data processing technologies such as Snowpark, Snow pipe, Apache Spark, and Databricks Delta Live Tables. The successful candidate will play a key role in evolving, deploying, and overseeing our advanced data infrastructure, pivotal for...

  • ETL Lead

    2 months ago

    Hyderabad, India Milestone Technologies, Inc. Full time

    Position Overview:We are looking for Lead ETL Developer. This pivotal role is dedicated to harnessing state-of-the-art data processing technologies such as Snowpark, Snow pipe, Apache Spark, and Databricks Delta Live Tables. The successful candidate will play a key role in evolving, deploying, and overseeing our advanced data infrastructure, pivotal for...

  • ETL Lead

    2 months ago

    Hyderabad, India Milestone Technologies, Inc. Full time

    Position Overview: We are looking for Lead ETL Developer. This pivotal role is dedicated to harnessing state-of-the-art data processing technologies such as Snowpark, Snow pipe, Apache Spark, and Databricks Delta Live Tables. The successful candidate will play a key role in evolving, deploying, and overseeing our advanced data infrastructure, pivotal for...

  • ETL Lead

    2 months ago

    hyderabad, India Milestone Technologies, Inc. Full time

    Position Overview:We are looking for Lead ETL Developer. This pivotal role is dedicated to harnessing state-of-the-art data processing technologies such as Snowpark, Snow pipe, Apache Spark, and Databricks Delta Live Tables. The successful candidate will play a key role in evolving, deploying, and overseeing our advanced data infrastructure, pivotal for...

  • ETL Lead

    2 weeks ago

    Hyderabad, India Vertex Offshore Services Pvt Ltd Full time

    Location : Hyderabad-WFOExperience : 10+ yearsKey Responsibilities :Leadership and Team Management :- Lead and mentor a team of team of 2 - 3 engineers.- Assign tasks, manage workloads, and ensure team members meet deadlines and project milestones.- Foster a collaborative and innovative team environment.Project Management :- Plan, design, and manage ETL...

  • Senior etl analyst(ai for etl)

    4 weeks ago

    Hyderabad, India Multiplier AI Full time

    Job Title: Senior ETL Analyst (AI for ETL)Location: Hyderabad (Onsite)Job Type: Full-TimeAbout Us:Multiplier AI is a leading AI company in India, focusing on healthcare. We help top pharmaceutical companies like Abbott, Cipla, Sun Pharma, Glenmark, and Galderma optimize operations and enhance decision-making with AI-driven products.Job Description:We are...

  • Senior ETL Analyst(AI for ETL)

    1 month ago

    Hyderabad, India Multiplier AI Full time

    Job Title: Senior ETL Analyst (AI for ETL)Location: Hyderabad (Onsite)Job Type: Full-TimeAbout Us:Multiplier AI is a leading AI company in India, focusing on healthcare. We help top pharmaceutical companies like Abbott, Cipla, Sun Pharma, Glenmark, and Galderma optimize operations and enhance decision-making with AI-driven products.Job Description:We are...

  • Senior ETL Analyst(AI for ETL)

    1 month ago

    Hyderabad, India Multiplier AI Full time

    Job Title: Senior ETL Analyst (AI for ETL) Location: Hyderabad (Onsite) Job Type: Full-Time About Us: Multiplier AI is a leading AI company in India, focusing on healthcare. We help top pharmaceutical companies like Abbott, Cipla, Sun Pharma, Glenmark, and Galderma optimize operations and enhance decision-making with AI-driven products. Job Description: We...

  • Lead ETL Developer for Insurance and Financial Services

    1 month ago

    Hyderabad, Telangana, India Rubis Software Solutions Private Limited Full time

    About the JobWe are seeking an experienced Lead ETL Developer to join our team at Rubis Software Solutions Private Limited. This role involves leading the development of ETL applications, providing technical expertise, and collaborating with cross-functional teams.Key ResponsibilitiesDeveloping, documenting, and maintaining ETL applications using IDMC,...

  • Multiplier AI | Senior ETL Analyst(AI for ETL) | hyderabad

    1 month ago

    Hyderabad, India Multiplier AI Full time

    Job Title: Senior ETL Analyst (AI for ETL)Location: Hyderabad (Onsite)Job Type: Full-TimeAbout Us:Multiplier AI is a leading AI company in India, focusing on healthcare. We help top pharmaceutical companies like Abbott, Cipla, Sun Pharma, Glenmark, and Galderma optimize operations and enhance decision-making with AI-driven products.Job Description:We are...

  • Senior ETL Architect

    3 weeks ago

    Hyderabad, Telangana, India Ingrain Systems Pvt Ltd Full time

    About Ingrain Systems Pvt LtdWe are a leading organization in the field of data integration and analytics.Job Title: Senior ETL ArchitectEstimated Salary: $140,000 - $200,000 per yearJob Summary:The role of an ETL (Extract, Transform, Load) architect is crucial in designing efficient data pipelines to extract, transform, and load data from various sources...

  • Multiplier AI | Senior ETL Analyst(AI for ETL) | hyderabad

    1 month ago

    hyderabad, India Multiplier AI Full time

    Job Title: Senior ETL Analyst (AI for ETL)Location: Hyderabad (Onsite)Job Type: Full-TimeAbout Us:Multiplier AI is a leading AI company in India, focusing on healthcare. We help top pharmaceutical companies like Abbott, Cipla, Sun Pharma, Glenmark, and Galderma optimize operations and enhance decision-making with AI-driven products.Job Description:We are...

  • DataStage ETL Developer

    3 weeks ago

    Hyderabad, Telangana, India Quess IT Staffing Full time

    Job Title: DataStage ETL DeveloperQuess IT Staffing is seeking a highly skilled and experienced DataStage ETL Developer to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and implementing efficient and scalable ETL flows using DataStage jobs and sequencers.Key Responsibilities:• Design and...

  • Multiplier AI | Senior ETL Analyst(AI for ETL) | hyderabad

    1 month ago

    hyderabad, India Multiplier AI Full time

    Job Title: Senior ETL Analyst (AI for ETL)Location: Hyderabad (Onsite)Job Type: Full-TimeAbout Us:Multiplier AI is a leading AI company in India, focusing on healthcare. We help top pharmaceutical companies like Abbott, Cipla, Sun Pharma, Glenmark, and Galderma optimize operations and enhance decision-making with AI-driven products.Job Description:We are...

  • Multiplier AI | Senior ETL Analyst(AI for ETL) | hyderabad

    1 month ago

    hyderabad, India Multiplier AI Full time

    Job Title: Senior ETL Analyst (AI for ETL) Location: Hyderabad (Onsite) Job Type: Full-Time About Us: Multiplier AI is a leading AI company in India, focusing on healthcare. We help top pharmaceutical companies like Abbott, Cipla, Sun Pharma, Glenmark, and Galderma optimize operations and enhance decision-making with AI-driven products. Job Description: We...

  • ETL Lead

    3 weeks ago

    Hyderabad, India Flipped.ai Full time

    About the Role : ETL Lead- Contractual JobMonthly Pay : 1,80,000Duration : 6 MonthLocation : HyderabadMode - Work From Office (5 Days) Time - India Time and U.S overlap.Timings : Full Time (As per company timings)Notice Period : within 15 days or immediate joinerExperience : 10+ Years Job Description : - Proven expert at writing SQL code with at least 10...

  • MS Azure ADF ETL Process Lead

    3 weeks ago

    Hyderabad, Telangana, India JTek Software Solutions Pvt Ltd Full time

    About Us: JTek Software Solutions Pvt Ltd is a leading software solutions company that provides innovative technology solutions to clients across various industries. Our team is passionate about delivering high-quality solutions that meet our clients' needs and exceed their expectations.Job Details:Job Title: MS Azure ADF ETL Process LeadLocation:...

  • Datastage ETL Engineer

    1 month ago

    Hyderabad, Telangana, India Ingrain Systems Pvt Ltd Full time

    Job Overview: Ingrain Systems Pvt Ltd is a leading provider of innovative data solutions. We are currently seeking an experienced Datastage ETL Engineer to join our team.Salary: ₹800,000 - ₹1,200,000 per annumJob Description:We are looking for a skilled Datastage ETL Engineer to design, develop, and maintain efficient data pipelines using IBM Datastage....

  • Software Development Lead

    4 weeks ago

    Hyderabad, Telangana, India Evernorth Health Services Full time

    About the RoleWe are seeking a highly skilled Software Development Lead to join our team at Evernorth Health Services. As a key member of our development team, you will be responsible for leading the development of software utilizing various technologies such as COBOL, DB2, CICS, and JCL.You will also be involved in the ETL development of software using...