Spark ETL Developer

4 weeks ago

bangalore, India Virtusa Full time

Job description Experience in designing, building, and delivering enterprise-wide data ingestion, data integration and data pipeline solutions using common programming language (Scala, Java, or Python) in a Big Data and Data Warehouse platform.Preferably with at least 5+ years of hands-on experience in a Data Engineering role. Experience in building data solution in Hadoop platform, using Spark, MapReduce, Sqoop, Kafka and various ETL frameworks for distributed data storage and processing.Preferably with at least 5+ years of hands-on experience. Strong Unix/Linux Shell scripting and programming skills in Scala, Java, or Python. Proficient in SQL scripting, writing complex SQLs for building data pipelines. Experience in leading and mentoring data engineers, including ownership of internal business stakeholder relationships and working with consultants. Experience in working in Agile teams, including working closely with internal business stakeholders. Familiarity with data warehousing and/or data mart build experience in Teradata, Oracle or RDBMS system is a plus. Certification on Cloudera CDP, Hadoop, Spark, Teradata is a plus. Experience in Ab Initio software products (GDE, Co> Operating System, Express> It, etc.), AWS products (S3, EMR, Redshift, etc.) is a plus. Qualification Experience in designing, building, and delivering enterprise-wide data ingestion, data integration and data pipeline solutions using common programming language (Scala, Java, or Python) in a Big Data and Data Warehouse platform.Preferably with at least 5+ years of hands-on experience in a Data Engineering role. Experience in building data solution in Hadoop platform, using Spark, MapReduce, Sqoop, Kafka and various ETL frameworks for distributed data storage and processing.Preferably with at least 5+ years of hands-on experience. Strong Unix/Linux Shell scripting and programming skills in Scala, Java, or Python. Proficient in SQL scripting, writing complex SQLs for building data pipelines. Experience in leading and mentoring data engineers, including ownership of internal business stakeholder relationships and working with consultants. Experience in working in Agile teams, including working closely with internal business stakeholders. Familiarity with data warehousing and/or data mart build experience in Teradata, Oracle or RDBMS system is a plus. Certification on Cloudera CDP, Hadoop, Spark, Teradata is a plus. Experience in Ab Initio software products (GDE, Co> Operating System, Express> It, etc.), AWS products (S3, EMR, Redshift, etc.) is a plus.

  • Quantexa Developer

    3 weeks ago

    bangalore, India IBU Consulting Full time

    Roles And Responsibilities :- Quantexa ETL and Scoring Development, configuration, and enhancements.- Technical delivery of Quantexa implementation utilizing the below support tools and methods.- Agile / DevOps delivery mode.- CI/CD pipelines.- Work with Kubernetes.- Basic understanding of MS Azure and Azure DevOps is a plus .- Hands-on experience with Scala...

  • Quantexa Developer

    1 month ago

    Bangalore, Karnataka, India IBU Consulting Full time

    Roles And Responsibilities :- Quantexa ETL and Scoring Development, configuration, and enhancements.- Technical delivery of Quantexa implementation utilizing the below support tools and methods.- Agile / DevOps delivery mode.- CI/CD pipelines.- Work with Kubernetes.- Basic understanding of MS Azure and Azure DevOps is a plus .- Hands-on experience with Scala...

  • Quantexa Developer

    3 weeks ago

    Bangalore, India IBU Consulting Full time

    Roles And Responsibilities :- Quantexa ETL and Scoring Development, configuration, and enhancements.- Technical delivery of Quantexa implementation utilizing the below support tools and methods.- Agile / DevOps delivery mode.- CI/CD pipelines.- Work with Kubernetes.- Basic understanding of MS Azure and Azure DevOps is a plus .- Hands-on experience with Scala...

  • Lead ETL Engineer

    1 month ago

    Bangalore, India YITRO BUSINESS CONSULTANTS (INDIA) PRIVATE LIMITED Full time

    Role : Lead ETL Feature EngineerYears of Experience : 5 to 9 yearsJob Location : BangaloreMode of Work : Work from officeShift : GeneralJob Type : PermanentResponsibilities : 1. Develop and maintain ETL pipelines to ingest and process large-scale datasets 2. Develop a Python connector designed for ETL applications, enabling the collection of historical...

  • Java spark developer

    4 days ago

    bangalore, India Virtusa Full time

    Java spark developer - CREQ189107 Description Position: Java Spark developer Primary skills: Java, spark, big data technologies Location: HYD/BLR Lead and manage the data processing team, providing guidance, mentorship, and performance feedback.8+ years of technical and/or management consulting experience architecting enterprise and application...

  • Hadoop Developer

    2 weeks ago

    Bangalore, Karnataka, India Andor Tech Full time

    Job Description :We are seeking a skilled Hadoop Developer with mandatory working experience in Elasticsearch to join our team. The ideal candidate should have a minimum of 2 years of experience in Hadoop and Spark development. This role will involve working with large datasets and implementing data processing solutions using Hadoop and Spark, with a...

  • Hadoop Developer

    2 weeks ago

    Bangalore, India Andor Tech Full time

    Job Description :We are seeking a skilled Hadoop Developer with mandatory working experience in Elasticsearch to join our team. The ideal candidate should have a minimum of 2 years of experience in Hadoop and Spark development. This role will involve working with large datasets and implementing data processing solutions using Hadoop and Spark, with a...

  • ETL Developer

    4 weeks ago

    Bangalore, Karnataka, India CIEL HR Full time

    Job Summary :- We are seeking an experienced ETL Developer to join our team.- The ETL Developer will be responsible for designing, developing, implementing, and maintaining ETL processes for our data warehouse.- The ideal candidate will have a strong understanding of ETL principles, data modeling, and database concepts, along with experience working with...

  • ETL Developer

    3 weeks ago

    Bangalore/Delhi, India CIEL HR Full time

    Job Summary :- We are seeking an experienced ETL Developer to join our team.- The ETL Developer will be responsible for designing, developing, implementing, and maintaining ETL processes for our data warehouse.- The ideal candidate will have a strong understanding of ETL principles, data modeling, and database concepts, along with experience working with...

  • Big Data Developer

    1 month ago

    bangalore, India Workassist.in Full time

    Our hiring partner is looking for :- This is a full-time on-site role for a Big Data Developer at Big Four Consulting Firm Gurugram.- The Big Data Developer will be responsible for tasks related to Data Engineering, Extract Transform Load (ETL), Big Data, Data Warehousing, and Software Data Engineering, Big Data, Extract Transform Load (ETL), and Data...

  • Abinitio Developer

    1 month ago

    Bangalore/Mumbai, Maharashtra, India Workassist.in Full time

    Role Description :- This is a full-time on-site role in Pune for an Abinitio Developer.- The Abinitio Developer will be responsible for Extract Transform Load (ETL), using ETL tools, data integration, data modeling, and analytical skills.- The role will involve day-to-day tasks related to ETL processes, data integration, and data modeling.- Developing...

  • Abinitio Developer

    3 weeks ago

    Bangalore/Mumbai, India Workassist.in Full time

    Role Description :- This is a full-time on-site role in Pune for an Abinitio Developer.- The Abinitio Developer will be responsible for Extract Transform Load (ETL), using ETL tools, data integration, data modeling, and analytical skills.- The role will involve day-to-day tasks related to ETL processes, data integration, and data modeling.- Developing...

  • Quantexa Developer

    1 month ago

    Bangalore/Pune, IN LOGIC PLANET IT SERVICES Full time

    Job Description : Roles and Responsibilities :- Quantexa ETL and Scoring Development, configuration, and enhancements.- Technical delivery of Quantexa implementation utilizing the below support tools and methods.- Agile / DevOps delivery mode.- CI/CD pipelines.- Work with Kubernetes.- Basic understanding of MS Azure and Azure DevOps is a plus .- Hands-on...

  • Quantexa Developer

    1 month ago

    Bangalore,Pune, India LOGIC PLANET IT SERVICES Full time

    Job Description : Roles and Responsibilities :- Quantexa ETL and Scoring Development, configuration, and enhancements.- Technical delivery of Quantexa implementation utilizing the below support tools and methods.- Agile / DevOps delivery mode.- CI/CD pipelines.- Work with Kubernetes.- Basic understanding of MS Azure and Azure DevOps is a plus .- Hands-on...

  • Scala Developer

    1 month ago

    Bangalore,Mumbai, India Growel Softech Pvt. Ltd. Full time

    Job Title : Spark/Scala Developer- "Meaningful experience with at least two of the following technologies: Python, Scala, SQL, Java- Experience and interest in Cloud platforms such as Azure (preferred) or AWS- Experience in Distributed Processing using Databricks (preferred) or Apache Spark- Ability to debug using tools like Ganglia UI, expertise in...

  • ETL Developer

    1 month ago

    Pune/Bangalore, IN Workassist.in Full time

    Our hiring partner is looking for :- This is a full-time on-site role for an ETL Developer (Abinito) located in Pune.- As an ETL Developer, your day-to-day tasks will involve Extract, Transform, and Load (ETL) processes.- You will work with ETL tools to integrate, model, and analyze data, ensuring efficient data flow and accuracy.- Your expertise in...

  • ETL Developer

    1 month ago

    Pune,Bangalore, India Workassist.in Full time

    Our hiring partner is looking for :- This is a full-time on-site role for an ETL Developer (Abinito) located in Pune.- As an ETL Developer, your day-to-day tasks will involve Extract, Transform, and Load (ETL) processes.- You will work with ETL tools to integrate, model, and analyze data, ensuring efficient data flow and accuracy.- Your expertise in...

  • ETL Developer

    1 month ago

    bangalore, India White Force Full time

    Job Description: Job Description: We are Hiring a ETL developer Skill : ETL, ETL process management, Determine data storage needs, Data analysis, ETL process.

  • ETL Developer

    1 month ago

    Jaipur/Udaipur/Rajasthan/Karnataka/Bangalore/Mysore, IN ATech Full time

    Job : ETL DeveloperSkills Required :- Experience in the database, data integration, and data migration- Good experience (3+ years) in development using databases such as Oracle, MS SQL Server, Teradata, etc.- Minimum of 2+ years of hands-on experience with Amazon Redshift.- Strong knowledge of the AWS environment and service knowledge with S3 storage...

  • ETL Developer

    1 month ago

    Jaipur,Udaipur,Rajasthan,Karnataka,Bangalore,Mysore, India ATech Full time

    Job : ETL DeveloperSkills Required :- Experience in the database, data integration, and data migration- Good experience (3+ years) in development using databases such as Oracle, MS SQL Server, Teradata, etc.- Minimum of 2+ years of hands-on experience with Amazon Redshift.- Strong knowledge of the AWS environment and service knowledge with S3 storage...