Data Engineer

4 days ago


ChennaiKolkataPuneBangaloreHyderabad, IN Risk Resources India Full time

ETL- Hadoop

Role and Responsibilities :

- Design Extract/Load/Transform (ETL) workflows to develop large scale data structures and pipelines to organize, collect and standardize data

- Uses knowledge of Hadoop architecture, HDFS commands and experience in designing, optimizing queries to build data pipelines

- Integrate data from a variety of sources, assuring that they adhere to data quality and accessibility standards

- Implemented endpoints to read data from BigQuery and Hive

- To provide user-defined functions for clients to read data from Hive and BigQuery directly without using any external connector jars

- Collaborate with data science team to transform data and integrate algorithms and models into automated processes using programming skills - Python or Hive

- Help in optimizing queries, and work to integrate the business requirements into existing campaign reporting data workflows

- Design and implement scalable, configurable and self-learning marketing campaign platform

Candidate Profile :

- Bachelor's degree in Engineering/Computer Science or related quantitative field

- Significant of advanced experience with data analysis, reporting and programming logic (Python, PySpark, Hive, SQL, shell scripting)

- Experience interacting with decision-making business audience

- Analyzes current information technology environment to identify and access critical capabilities and recommend solutions

- Experiments with available tools and advices on new tolls in order to determine optimal solutions given the requirements dictated by the model/use case

- Good software engineering fundamentals, strong problem solving and critical thinking ability.

(ref:hirist.tech)
  • Senior Data Engineer

    3 weeks ago


    Bangalore/Chennai/Hyderabad/Pune, IN Capabiliq IT Services Private Limited Full time

    As a Senior Data Engineer, you will work to solve some of the organizational data management problems that would enable them as a data-driven organization; Seamlessly switch between roles of an Individual Contributor, team member and Data Modeling lead as demanded by each project to define, design, and deliver actionable insights.On a typical day, you might...

  • Data Engineer

    1 week ago


    Mumbai/Bangalore/Pune/Chennai/Hyderabad, IN Changeleaders Full time

    Company Overview :Tech Mahindra is a leading provider of digital transformation, consulting, and business re-engineering services and solutions. We leverage next-generation technologies to help our clients achieve their business objectives.Job Summary :We are looking for an experienced Azure Data Engineer to join our dynamic team. The ideal candidate will be...

  • Data Engineer

    1 day ago


    Chennai/Bangalore/Pune/Hyderabad/Noida, IN MNR Solutions Full time

    Job Description :We are looking for an experienced AWS Data Engineer to join our team. The ideal candidate will have extensive knowledge of AWS data services and a strong background in data engineering. This role involves designing, implementing, and maintaining data pipelines and architectures to support business intelligence and analytics initiatives.Key...

  • AWS Data Engineer

    2 weeks ago


    Bangalore/Chennai/Hyderabad/Pune, IN MNR Solutions Full time

    Job Description :We are looking for an experienced AWS Data Engineer to join our dynamic team. The ideal candidate will have over 9 years of experience and strong expertise in AWS services, especially AWS RDS, data formats like JSON, CSV, XML, and hands-on experience in QlikSense and SQL.Key Responsibilities :- Design, develop, and optimize data pipelines...

  • Azure Data Engineer

    3 weeks ago


    Pune/Hyderabad/Bangalore/Chennai, IN BSRI Solutions Full time

    Job Description :We are seeking a talented and experienced Azure Data Engineer to join our team. The ideal candidate will have a strong background in data engineering with a focus on Microsoft Azure services. The candidate should have a minimum of 5-10 years of hands-on experience with Azure Data Factory (ADF), Azure Synapse Analytics, Synapse Pipelines,...

  • Nuviso Networks

    2 weeks ago


    Hyderabad/Chennai/Bangalore, IN Nuviso Networks Full time

    1. Data Engineering & Development :- Design, develop, and maintain scalable data pipelines using Azure Databricks.- Implement ETL processes to ingest and transform data from various sources.2. Data Management :- Develop and maintain Delta Lake tables for efficient data storage and retrieval.- Ensure data quality and integrity through rigorous testing and...


  • Bangalore/Pune/Chennai/Hyderabad, IN Foundit Full time

    Job Description :Tech Skills Required :- Minimum 5 years of experience with Azure development and data solutions.- High proficiency with Azure data technologies (Azure Data Factory, Databricks, Azure Synapse Analytics).- Strong proficiency in SQL and writing complex data queries.- Deep experience in all stages of Data Analysis, including data source...

  • Data Engineer

    3 weeks ago


    Hyderabad/Chennai/Bangalore/Delhi/Kolkata/Mumbai/Pune, IN MLOPS SOLUTIONS PRIVATE LIMITED Full time

    Job Title : GCP Data EngineerExperience : 6-8 YearsLocations : Hyderabad, Chennai, Bangalore, Pune, Mumbai,, Kolkata & DelhiNotice period: 15 DaysWork mode : Hybrid (2 Days work from office)Job type : FTE/C2HRole Description :We are seeking an experienced GCP Data Engineer with 6-8 years of experience to join our team. The ideal candidate will be responsible...

  • Data Engineer

    5 months ago


    Mumbai/Bangalore/Hyderabad/Chennai/Pune/Delhi, IN VARITE Inc. Full time

    Job Title: Data EngineerLocation City : Hyderabad, bangalore, chennai, mumbai, new delhi, pune.Experience Required : 4+Shift: Day ShiftWork Mode: OnsitePosition Type: ContractOpenings: 3Company Name : VARITE INDIA PRIVATE LIMITEDAbout The Client: A multinational technology and e-commerce company based in the United States is widely recognized as one of the...

  • Data Engineer

    2 weeks ago


    Hyderabad/Pune, IN Selsoft Full time

    Salary : 27-41 LPARole : Data : 5.5 years to 13 yearsLocation : HyderabadKey Skills : Python, Pyspark, Spark, Kafka, AWS Glue and other AWS servicesJob Description :- 5+ to 13 years of relevant work experience showing growth as a Data Engineer.- Hands On programming experience- Implementation Experience on Kafka, Kinesis, Spark, AWS Glue, AWS LakeFormation.-...

  • Senior Data Engineer

    3 weeks ago


    Bangalore/Hyderabad/Chennai, IN InstaTalent Recruit LLP Full time

    Job Description :Job Title : Senior Data Engineer - SynapseLocation : Bengaluru, Chennai, HyderabadExperience : 7 to 10 YearsEmployment Type : Full-timeMust Have Skills : Azure Synapse, Azure, Azure Datalake, ADF, Azure your typical day would look like :As a Senior Data Engineer, you will have the opportunity to solve some of the most captivating data...

  • Senior Data Engineer

    3 weeks ago


    Chennai/Hyderabad/Bangalore, IN INUMELLAS CONSULTANCY SERVICES PRIVATE LIMITED Full time

    Job Title : Senior Data Engineer - DBTLocation : Chennai , Hyderabad , BangaloreWho we are :Tiger Analytics is a global leader in AI and analytics, helping Fortune 1000 companies solve their toughest challenges. We offer :Fullstack AI and analytics services & solutions to empower businesses to achieve real outcomes and value at scale. We are on a mission to...

  • Senior Data Engineer

    3 weeks ago


    Bangalore/Karnataka/Pune/Hyderabad, IN InstaTalent Recruit LLP Full time

    Job Description :As a Senior Data Engineer, you will work to solve some of the most complex and captivating data management problems that would enable them as a data-driven organization; Seamlessly switch between roles of an Individual Contributor, team member, and Data Modeling Architect as demanded by each project to define, design, and deliver actionable...


  • Bangalore/Hyderabad/Delhi/Kolkata, IN Freelance Full time

    Job DescriptionSenior resource with minimum 2-8 Years of experience in Tableau.- Very strong experience on Tableau Functions, Tableau Data Prep and Tableau Visuals.- Good experience on end-to-end Enterprise BI development & deployment.- Developing data Models, Data Preparation with Data Flows and designing BI reports- Proven experience in writing advanced...


  • Bangalore/Pune, IN MaimsD Technology Full time

    Role : Data Visualization EngineerLocation : Bangalore, PuneExperience : 4 - 7 YrsEmployment Type : Full Time, PermanentWorking mode : RegularNotice Period : Immediate - 15 DayAbout the Role :We are seeking a skilled Data Visualization Engineer to join our team and transform raw data into actionable insights. You will play a crucial role in designing,...

  • Data Engineer

    2 weeks ago


    Delhi NCR/Bangalore/Hyderabad/Chennai, IN ANLAGE Full time

    Job Overview : We are seeking a highly skilled and motivated Scala Data Engineer to join our team. In this role, you will design, build, and maintain large-scale data processing systems. The ideal candidate will have a strong background in Scala programming, distributed data processing frameworks, and a deep understanding of data architecture and pipelines....

  • Data Engineer

    3 weeks ago


    Chennai/Bangalore/Hyderabad, IN True Talents Consulting Private Limited Full time

    Responsibilities :- Responsible for day-to-day development process and overseeing the implementation of the technical design, data profiling and data analysis.- Deploy, Run, and Debug the ETL engine running the scripts built by the ETL Engineering team.- Exposure towards Source to Target Mapping and Function Requirement Specifications Docs.- Develop a deep...


  • Pune/Noida/Hyderabad/Chennai/Bangalore, IN TETRAHED INC Full time

    About the Role : We are seeking a highly skilled Senior Big Data Engineer/Architect to design, develop, and implement robust data solutions on the Google Cloud Platform (GCP). You will be responsible for architecting and building scalable data pipelines, data warehouses, and data lakes to support critical business operations.Responsibilities : - Define and...

  • Data Engineer

    3 weeks ago


    Pune/Bangalore, IN TekIT Software Solutions Pvt. Ltd. Full time

    Key Responsibilities :Data Modeling and Design : - Develop and implement effective data models (e.g., Star, Snowflake) to support analytical and operational reporting requirements. - Ensure data quality, consistency, and integrity throughout the data lifecycle. Data Pipelining and ETL : - Design, build, and maintain efficient ETL pipelines to extract,...

  • GCP Data Engineer

    1 week ago


    Bangalore/Hyderabad/Chennai, IN TechnoGen India Private Limited Full time

    What you'll be doing :As a Data Engineer with ETL/ELT expertise for our growing data platform and analytics teams, you will understand and enable the required data sets from different sources. You will take both structured and unstructured data into our data warehouse and data lake with real-time streaming and/or batch processing to generate insights and...