Data Engineer

3 weeks ago


HyderabadChennaiPune, IN Freelancer HR Full time

Description :

Job Description :

- Designing and implementing highly performant data ingestion pipelines from multiple sources using Apache Spark and/or Azure Data bricks and/or HDInsights

- Experience with other Open Source big data products Hadoop (incl. Hive, Pig, Impala)

- Experience with Open Source non-relational / NoSQL data repositories (incl. MongoDB, Cassandra, Neo4J)

- Direct experience of building data pipelines using HDInsights and Apache Spark (preferably Databricks).

- Experience using geospatial frameworks on Apache Spark and associated design and development patterns

- Microsoft Azure Big Data Architecture certification.

Note :

Mandatory Skills : Spark, Apache, Kafka, NoSQL, SQL, ETL Engineer, Azure Data bricks, Azure HDInsight, Hive Impala Azure, Stream Analytics, Azure Data Lake Storage

Immediate to serving notice (Need only May joiner)

(ref:hirist.tech)
  • Data Engineer

    1 month ago


    Hyderabad/Chennai/Pune, IN Freelancer HR Full time

    Description :Job Description :- Designing and implementing highly performant data ingestion pipelines from multiple sources using Apache Spark and/or Azure Data bricks and/or HDInsights- Experience with other Open Source big data products Hadoop (incl. Hive, Pig, Impala)- Experience with Open Source non-relational / NoSQL data repositories (incl. MongoDB,...


  • Chennai/Pune, IN IMS consulting company Full time

    Job Description :As a Manager of Data Quality Engineering, you will lead a team responsible to ensure the accuracy, integrity, and reliability of data across the organization. You will collaborate closely with various stakeholders including data engineers, data scientists, product managers, and business analysts to establish and maintain robust data quality...


  • Chennai/Pune/Hyderabad, IN Arting Digital Full time

    Job Title : Data Engineer/ETL DeveloperExperience : 7+yrLocation : Hyderabad, Ahmedabad, Pune, Indore, GurgaonWork mode : Onsite Qualification : B.TECH , M.Tech, MCAJob Description :Skills : 1. Strong SQL knowledge. 2. Deep understanding of data warehousing concepts, dimensional modeling, and data mart design principles. 3. Experience with Snowflake...


  • Bangalore/Chennai/Hyderabad, IN PPLABILITY PRIVATE LIMITED Full time

    Job Title: Senior Data Engineer-Data Modeling. Location: Bengaluru, Chennai, about the role? What your typical day would look like? As a Senior Data Engineer, you will work to solve some of the organizational data management problems that would enable them as a data-driven organization; Seamlessly switch between roles of an Individual Contributor, team...


  • Chennai/Pune, IN Nexionpro Services LLP Full time

    Years of Exp : 15+ yearsSkills : Python, Pytest, AWS-Lambda, Glue, SQL, MDMLocation : Chennai and PuneNotice Period : Immediate - 60 daysAs a Manager of Data Quality Engineering, you will lead a team responsible to ensure the accuracy, integrity, and reliability of data across the organization. You will collaborate closely with various stakeholders including...

  • Data Engineer

    3 weeks ago


    Pune/Mumbai/Hyderabad/Chennai/Bangalore, IN RapidBraiins Full time

    Position Overview :As a Talend - Data Engineering Specialist, you will play a key role in designing, developing, and maintaining data pipelines using Talend, AWS, and SQL. You will work closely with cross-functional teams to gather requirements, design data solutions, and implement scalable and efficient ETL processes. Additionally, you will leverage your...

  • Data Engineer

    2 months ago


    Pune/Mumbai/Hyderabad/Chennai/Bangalore, IN RapidBraiins Full time

    Position Overview :As a Talend - Data Engineering Specialist, you will play a key role in designing, developing, and maintaining data pipelines using Talend, AWS, and SQL. You will work closely with cross-functional teams to gather requirements, design data solutions, and implement scalable and efficient ETL processes. Additionally, you will leverage your...

  • Data Engineer

    2 months ago


    Pune/Hyderabad, IN Promaynaov Advisory Services Pvt Ltd Full time

    Role : Data EngineerLocation : Pune/HyderabadIn this role, you will : Principal Responsibilities :As a key member of the technical team alongside Engineers, Data Scientists and Data Users, you will be expected to define and contribute at a high-level to many aspects of our collaborative Agile development process - Software design, Scala & Spark development,...

  • Data Engineer

    3 weeks ago


    Pune/Hyderabad, IN Promaynaov Advisory Services Pvt Ltd Full time

    Role : Data EngineerLocation : Pune/HyderabadIn this role, you will : Principal Responsibilities :As a key member of the technical team alongside Engineers, Data Scientists and Data Users, you will be expected to define and contribute at a high-level to many aspects of our collaborative Agile development process - Software design, Scala & Spark development,...

  • Data Engineer

    3 weeks ago


    Mumbai/Bangalore/Hyderabad/Chennai/Pune/Delhi, IN VARITE Inc. Full time

    Job Title: Data EngineerLocation City : Hyderabad, bangalore, chennai, mumbai, new delhi, pune.Experience Required : 4+Shift: Day ShiftWork Mode: OnsitePosition Type: ContractOpenings: 3Company Name : VARITE INDIA PRIVATE LIMITEDAbout The Client: A multinational technology and e-commerce company based in the United States is widely recognized as one of the...

  • Data Engineer

    3 weeks ago


    Mumbai/Bangalore/Hyderabad/Chennai/Pune/Delhi, IN VARITE Inc. Full time

    Job Title: Data EngineerLocation City : Hyderabad, bangalore, chennai, mumbai, new delhi, pune.Experience Required : 4+Shift: Day ShiftWork Mode: OnsitePosition Type: ContractOpenings: 3Company Name : VARITE INDIA PRIVATE LIMITEDAbout The Client: A multinational technology and e-commerce company based in the United States is widely recognized as one of the...

  • AI/ML Engineer

    2 months ago


    Bangalore/Pune/Hyderabad/Chennai, IN Nilasu consulting Full time

    Summary :We are seeking a talented and passionate AI/Machine Learning Engineer to join our team. You will play a key role in the entire lifecycle of machine learning projects, from data engineering and classical machine learning to potentially exploring deep learning and natural language processing techniques. Your strong foundation in Python coding,...

  • AI/ML Engineer

    3 weeks ago


    Bangalore/Pune/Hyderabad/Chennai, IN Nilasu consulting Full time

    Summary :We are seeking a talented and passionate AI/Machine Learning Engineer to join our team. You will play a key role in the entire lifecycle of machine learning projects, from data engineering and classical machine learning to potentially exploring deep learning and natural language processing techniques. Your strong foundation in Python coding,...

  • Azure Data Engineer

    3 weeks ago


    Pune/Bangalore/Chennai, IN Growel Softech Pvt. Ltd. Full time

    Job Title : Azure Data EngineerLocations : Pune, Bangalore, ChennaiExperience Required : 4 - 10 yearsJob Description :We are looking for an experienced Azure Data Engineer to join our dynamic team. The ideal candidate will have a strong background in data engineering with hands-on experience in designing and implementing data solutions using Microsoft Azure....

  • Lead Data Engineer

    2 months ago


    Bangalore/Pune/Hyderabad/Chennai, IN Nilasu consulting Full time

    We are seeking a highly skilled and experienced Data Engineer with a passion for the healthcare industry to join our growing team!In this pivotal role, you will play a key role in building and maintaining our data lake infrastructure. You will leverage your expertise in data pipelines, cloud technologies, and healthcare data to design, develop, and deploy...

  • Lead Data Engineer

    3 weeks ago


    Bangalore/Pune/Hyderabad/Chennai, IN Nilasu consulting Full time

    We are seeking a highly skilled and experienced Data Engineer with a passion for the healthcare industry to join our growing team!In this pivotal role, you will play a key role in building and maintaining our data lake infrastructure. You will leverage your expertise in data pipelines, cloud technologies, and healthcare data to design, develop, and deploy...


  • Chennai/Pune, IN NEXIONPRO SERVICES LLP Full time

    Experience : 15+ yrsSkills : Python, Py test, AWS-Lambda, Glue, SQL, MDMLocation : Chennai and PuneNotice Period : Immediate - 60 daysJob Description :As a Manager of Data Quality Engineering, you will lead a team responsible to ensure the accuracy, integrity, and reliability of data across the organization. You will collaborate closely with various...

  • Data Engineer

    6 days ago


    Bangalore/Pune/Chennai/Hyderabad/Gurgaon/Gurugram/Panchkula, IN Mobile Programming LLC Full time

    Job Description : Job Title : Data EngineerExperience : 5+ Years (Relevant)Work Mode : RemoteNotice Period : Immediate to 15 daysJob Description :We are seeking an experienced Data Engineer with a strong background in data engineering technologies to join our remote team. The ideal candidate will have 6+ years of relevant experience and will be responsible...

  • Data Engineer

    3 weeks ago


    Pune/Hyderabad, IN EDGESOFT Full time

    Job Description :The ideal candidate should have a robust understanding and hands-on expertise in PySpark and various components within DataBricks. As a crucial member of our data team, you will play a pivotal role in developing, optimizing, and maintaining our data infrastructure, ensuring seamless and efficient data processing.Responsibilities :- Design,...

  • Data Engineer

    3 weeks ago


    Pune/Hyderabad, IN EDGESOFT Full time

    Job Description :The ideal candidate should have a robust understanding and hands-on expertise in PySpark and various components within DataBricks. As a crucial member of our data team, you will play a pivotal role in developing, optimizing, and maintaining our data infrastructure, ensuring seamless and efficient data processing.Responsibilities :- Design,...