Data Engineer

2 weeks ago

PuneMumbaiHyderabadChennaiBangalore, IN RapidBraiins Full time

Position Overview :

As a Talend - Data Engineering Specialist, you will play a key role in designing, developing, and maintaining data pipelines using Talend, AWS, and SQL. You will work closely with cross-functional teams to gather requirements, design data solutions, and implement scalable and efficient ETL processes.

Additionally, you will leverage your expertise in AWS services and Snowflake to optimize data integration and storage in the cloud environment.

Key Responsibilities :

- Design, develop, and maintain data pipelines using Talend, AWS, and SQL to support data integration, transformation, and loading processes.

- Implement best practices for data engineering, including data modeling, schema design, and performance tuning, to ensure optimal performance and scalability.

- Collaborate with stakeholders to gather requirements and translate them into technical specifications and data solutions.

- Leverage your expertise in AWS services, including S3, EC2, Redshift, and Snowflake, to optimize data storage and processing in the cloud environment.

- Develop and maintain documentation, standard operating procedures (SOPs), and data lineage documentation to ensure transparency and compliance with data governance policies.

- Troubleshoot and resolve issues related to data pipelines, ensuring data quality and integrity throughout the data lifecycle.

- Provide technical leadership and mentorship to junior team members, and actively participate in knowledge sharing and skill development initiatives.

Required Skills and Qualifications :

- Bachelor's degree in Computer Science, Information Technology, or a related field.

- 5-12 years of experience in data engineering, with a focus on Talend, AWS, and SQL.

- Must have experience with Talend, AWS, and Snowflake, with additional experience in Spark considered a plus.

- Strong analytical and problem-solving skills, with the ability to break down complex problems and implement effective solutions.

- Solid understanding of ETL concepts and hands-on experience with Talend ETL Tool (Basic & Advanced).

- Experience writing SQL queries, stored procedures, and creating marts/views in Teradata/SQL.

- Good knowledge of AWS services, particularly S3, EC2, Redshift, and Snowflake.

- Excellent communication and interpersonal skills, with the ability to work effectively in a team environment.

(ref:hirist.tech)

  • Data Engineer

    2 weeks ago

    Mumbai/Bangalore/Hyderabad/Chennai/Pune/Delhi, IN VARITE Inc. Full time

    Job Title: Data EngineerLocation City : Hyderabad, bangalore, chennai, mumbai, new delhi, pune.Experience Required : 4+Shift: Day ShiftWork Mode: OnsitePosition Type: ContractOpenings: 3Company Name : VARITE INDIA PRIVATE LIMITEDAbout The Client: A multinational technology and e-commerce company based in the United States is widely recognized as one of the...

  • Data Engineer

    2 weeks ago

    Mumbai/Bangalore/Hyderabad/Chennai/Pune/Delhi, IN VARITE Inc. Full time

    Job Title: Data EngineerLocation City : Hyderabad, bangalore, chennai, mumbai, new delhi, pune.Experience Required : 4+Shift: Day ShiftWork Mode: OnsitePosition Type: ContractOpenings: 3Company Name : VARITE INDIA PRIVATE LIMITEDAbout The Client: A multinational technology and e-commerce company based in the United States is widely recognized as one of the...

  • Azure Data Engineer

    2 weeks ago

    Pune/Bangalore/Chennai, IN Growel Softech Pvt. Ltd. Full time

    Job Title : Azure Data EngineerLocations : Pune, Bangalore, ChennaiExperience Required : 4 - 10 yearsJob Description :We are looking for an experienced Azure Data Engineer to join our dynamic team. The ideal candidate will have a strong background in data engineering with hands-on experience in designing and implementing data solutions using Microsoft Azure....

  • Aptus Data Labs

    2 weeks ago

    Bangalore/Hyderabad/Gurgaon/Gurugram/Mumbai, IN Aptus Data Labs Full time

    Description :We are seeking an experienced and talented individual for the position of Data Governance with Azure experience. In this role, you will be responsible for managing the data governance framework using Azure tools and technologies, and collaborating closely with cross-functional teams to implement and maintain best practices.Location :...

  • AI/ML Engineer

    2 weeks ago

    Bangalore/Pune/Hyderabad/Chennai, IN Nilasu consulting Full time

    Summary :We are seeking a talented and passionate AI/Machine Learning Engineer to join our team. You will play a key role in the entire lifecycle of machine learning projects, from data engineering and classical machine learning to potentially exploring deep learning and natural language processing techniques. Your strong foundation in Python coding,...

  • AI/ML Engineer

    2 months ago

    Bangalore/Pune/Hyderabad/Chennai, IN Nilasu consulting Full time

    Summary :We are seeking a talented and passionate AI/Machine Learning Engineer to join our team. You will play a key role in the entire lifecycle of machine learning projects, from data engineering and classical machine learning to potentially exploring deep learning and natural language processing techniques. Your strong foundation in Python coding,...

  • Data Engineer

    2 weeks ago

    Hyderabad/Chennai/Pune, IN Freelancer HR Full time

    Description :Job Description :- Designing and implementing highly performant data ingestion pipelines from multiple sources using Apache Spark and/or Azure Data bricks and/or HDInsights- Experience with other Open Source big data products Hadoop (incl. Hive, Pig, Impala)- Experience with Open Source non-relational / NoSQL data repositories (incl. MongoDB,...

  • Data Engineer

    1 month ago

    Hyderabad/Chennai/Pune, IN Freelancer HR Full time

    Description :Job Description :- Designing and implementing highly performant data ingestion pipelines from multiple sources using Apache Spark and/or Azure Data bricks and/or HDInsights- Experience with other Open Source big data products Hadoop (incl. Hive, Pig, Impala)- Experience with Open Source non-relational / NoSQL data repositories (incl. MongoDB,...

  • Lead Data Engineer

    2 weeks ago

    Bangalore/Pune/Hyderabad/Chennai, IN Nilasu consulting Full time

    We are seeking a highly skilled and experienced Data Engineer with a passion for the healthcare industry to join our growing team!In this pivotal role, you will play a key role in building and maintaining our data lake infrastructure. You will leverage your expertise in data pipelines, cloud technologies, and healthcare data to design, develop, and deploy...

  • Lead Data Engineer

    1 month ago

    Bangalore/Pune/Hyderabad/Chennai, IN Nilasu consulting Full time

    We are seeking a highly skilled and experienced Data Engineer with a passion for the healthcare industry to join our growing team!In this pivotal role, you will play a key role in building and maintaining our data lake infrastructure. You will leverage your expertise in data pipelines, cloud technologies, and healthcare data to design, develop, and deploy...

  • Senior Manager/Head

    2 weeks ago

    Chennai/Hyderabad/Bangalore, IN Spectrum Consulting Full time

    Position Overview :As the leader of our Data Engineering team, you will be responsible for driving the design, development, deployment and maintenance of our data architecture, pipelines, and processes across both Azure and AWS cloud environments. You will play a critical role in shaping our data strategy, ensuring scalability, reliability, and efficiency...

  • Senior Manager/Head

    2 weeks ago

    Chennai/Hyderabad/Bangalore, IN Spectrum Consulting Full time

    Position Overview :As the leader of our Data Engineering team, you will be responsible for driving the design, development, deployment and maintenance of our data architecture, pipelines, and processes across both Azure and AWS cloud environments. You will play a critical role in shaping our data strategy, ensuring scalability, reliability, and efficiency...

  • Azure Data Engineer

    2 weeks ago

    Bangalore/Hyderabad/Pune, IN Kezan Consulting Full time

    Work Timings : 10 AM - 7 PMNumber of Openings : 5Joining Date : Within a weekJob Description :We are seeking experienced Azure Data Engineers to join our team on a contractual basis. As an Azure Data Engineer, you will be responsible for designing, implementing, and maintaining data solutions on the Azure platform. The ideal candidate will have a strong...

  • Azure Data Engineer

    2 months ago

    Bangalore/Hyderabad/Pune, IN Kezan Consulting Full time

    Work Timings : 10 AM - 7 PMNumber of Openings : 5Joining Date : Within a weekJob Description :We are seeking experienced Azure Data Engineers to join our team on a contractual basis. As an Azure Data Engineer, you will be responsible for designing, implementing, and maintaining data solutions on the Azure platform. The ideal candidate will have a strong...

  • Senior Data Engineer

    2 months ago

    Chennai/Bangalore/Hyderabad/Pune, IN Resourcetree Full time

    Job Description :Data engineering role requires creating and managing technological infrastructure of a data platform, be in- charge / involved in architecting, building, and managing data flows / pipelines and construct data storages (noSQL, SQL), tools to work with big data (Hadoop, Kafka), and integration tools to connect sources or other databases.Role...

  • Data Engineer

    2 weeks ago

    Chennai/Mumbai/Pune/Bangalore, IN Ashra Technologies Full time

    AWS Glue Snowflake. Experience : 6+years. Locations : Pune,Mumbai,Chennai,Bangalore. Job Description- Data Engineer with experience using AWS Glue with experience in Snowflake and a good understanding of dbt (data build tool).- The candidate will have a strong background in data engineering, with hands-on experience in building and optimizing ETL pipelines...

  • Lead Data Engineer

    3 weeks ago

    Hyderabad/Bangalore/Pune, IN SKANDHA IT SERVICES PRIVATE LIMITED Full time

    Lead Data Engineer Locations : Hyderabad, Bengaluru, Pune. Skills :- Programming : Python , Pyspark/Scala, Flask.- API Microservices , ECS Fargate.- Bigdata AWS : EMR, Glue, Athena, Redshift, Lambda.- Analytics : AWS Quicksight.- Database : Postgres RDS,Mongo (SQL/NoSQL).- Orchestration : preferably Airflow.About the Role : We are searching for a talented...

  • Senior Data Engineer

    2 weeks ago

    Hyderabad/Pune/Bangalore, IN iMind Your Business Solutions Private Limited Full time

    Job Description :We are hiring Data Engineers for the leaders In Analytics & Cloud Applications, headquartered in San Francisco and have offices in India (Bangalore, Hyderabad and Pune).Our client provides strategic guidance and technology systems for clients wishing to solve their most complex and interesting business challenges involving cloud...

  • Lead Data Engineer

    2 weeks ago

    Bangalore/Hyderabad/Pune, IN iMind Your Business Solutions Private Limited Full time

    Job Description :We are hiring Lead Data Engineers for the leaders In Analytics & Cloud Applications, headquartered in San Francisco and have offices in India (Bangalore, Hyderabad and Pune)Our client provides strategic guidance and technology systems for clients wishing to solve their most complex and interesting business challenges involving cloud...

  • Senior Data Engineer

    2 months ago

    Hyderabad/Pune/Bangalore, IN iMind Your Business Solutions Private Limited Full time

    Job Description :We are hiring Data Engineers for the leaders In Analytics & Cloud Applications, headquartered in San Francisco and have offices in India (Bangalore, Hyderabad and Pune).Our client provides strategic guidance and technology systems for clients wishing to solve their most complex and interesting business challenges involving cloud...