Data Engineer

4 weeks ago


ChennaiHyderabadBangalore, IN HNM Solutions Full time

Note : Only immediate joiner

Role : Pyspark

Experience : 8+ years

Location : Hyderabad, Chennia

Interview mode is Walkin drive

Requirements :

Mandatory skills : (8+ Years of experience in Data engineering with 5+ Years on Pyspark/NoSQL is Mandatory)


1. Person should be strong in Pyspark

2. Should have hands on in MWAA (Airflow) / AWS EMR(Hadoop, Hive) framework

3. Hands on and working knowledge in Python

4. Knowledge in AWS services like EMR , S3, Lamda, Step Function, Aurora - RDS.

5. Having good knowldge on RDBMS Any SQL

6. Person should work as Individual contributor

Good to have :

1. Having experience to convert large set of data from RDMBS to No SQL.

2. Having experience to build data lake & configuration on delta tables.

3. Having good experience with computing & cost optimization.

4. Understanding the environment and use case and ready to build holistic frame works.

Soft skill :

1. Having good communication to interact with IT-Stake holders and Business.

2. Understand the pain point to delivery.

(ref:hirist.tech)
  • Data Engineer

    4 weeks ago


    Bangalore/Chennai/Hyderabad, IN Cortex Consulting Pvt. Ltd. Full time

    Responsibilities :- Design, construct, install, test, and maintain highly scalable data management systems.- Develop and implement ETL processes to collect, store, and process data from various sources.- Build and optimize data pipelines for efficient data ingestion and transformation.- Collaborate with data analysts and data scientists to understand data...

  • Python Data Engineer

    4 weeks ago


    Bangalore/Hyderabad/Pune/Mumbai/Chennai, IN Swift Strategic Staff Solutions INC Full time

    Job Description :We are seeking a talented and experienced Python Data Engineer to join our data team and play a crucial role in building, maintaining, and optimizing data pipelines for our cloud-based data warehouse.Responsibilities :- Design, develop, and implement data pipelines for ingesting, transforming, and loading data into Snowflake using Python...


  • Bangalore/Hyderabad/Chennai/Pune, IN CGI Information Systems and Management Consultants Full time

    Required Skills :- 5+ years of experience in database administration duties- Bachelor's degree (or equivalent) in computer science, information technology, engineering, or related discipline- Experience in building or maintaining ETL processes.- Experienced in working with big data analytics tools.- Need to be proficient in various database types and...

  • Data Engineer

    4 weeks ago


    Pune/Mumbai/Hyderabad/Chennai/Bangalore, IN RapidBraiins Full time

    Position Overview :As a Talend - Data Engineering Specialist, you will play a key role in designing, developing, and maintaining data pipelines using Talend, AWS, and SQL. You will work closely with cross-functional teams to gather requirements, design data solutions, and implement scalable and efficient ETL processes. Additionally, you will leverage your...

  • AI/ML Engineer

    4 weeks ago


    Bangalore/Pune/Hyderabad/Chennai, IN Nilasu consulting Full time

    Summary :We are seeking a talented and passionate AI/Machine Learning Engineer to join our team. You will play a key role in the entire lifecycle of machine learning projects, from data engineering and classical machine learning to potentially exploring deep learning and natural language processing techniques. Your strong foundation in Python coding,...

  • Lead Data Engineer

    1 week ago


    Bangalore/Pune/Hyderabad/Chennai, IN Nilasu consulting Full time

    We are seeking a highly skilled and experienced Data Engineer with a passion for the healthcare industry to join our growing team!In this pivotal role, you will play a key role in building and maintaining our data lake infrastructure. You will leverage your expertise in data pipelines, cloud technologies, and healthcare data to design, develop, and deploy...

  • Data Engineer

    17 hours ago


    Hyderabad/Chennai/Pune, IN Freelancer HR Full time

    Description :Job Description :- Designing and implementing highly performant data ingestion pipelines from multiple sources using Apache Spark and/or Azure Data bricks and/or HDInsights- Experience with other Open Source big data products Hadoop (incl. Hive, Pig, Impala)- Experience with Open Source non-relational / NoSQL data repositories (incl. MongoDB,...

  • Azure Data Engineer

    2 weeks ago


    Bangalore/Hyderabad/Pune, IN Kezan Consulting Full time

    Work Timings : 10 AM - 7 PMNumber of Openings : 5Joining Date : Within a weekJob Description :We are seeking experienced Azure Data Engineers to join our team on a contractual basis. As an Azure Data Engineer, you will be responsible for designing, implementing, and maintaining data solutions on the Azure platform. The ideal candidate will have a strong...

  • Senior Data Engineer

    4 weeks ago


    Chennai/Bangalore/Hyderabad/Pune, IN Resourcetree Full time

    Job Description :Data engineering role requires creating and managing technological infrastructure of a data platform, be in- charge / involved in architecting, building, and managing data flows / pipelines and construct data storages (noSQL, SQL), tools to work with big data (Hadoop, Kafka), and integration tools to connect sources or other databases.Role...

  • Lead Data Engineer

    17 hours ago


    Chennai/Bangalore/Hyderabad, IN Cynosure Corporate Solutions Full time

    Job Description :- 10+ years of design & development experience with big data technologies like Azure, AWS or GCP- Preferred is Azure & Databricks, with experience in Azure DevOps- Experience in data visualizing technology in DL, like PowerBI- Proficient in Python, PySpark and SQL- Proficient in querying and manipulating data from various DB (relational and...

  • Data Engineer

    4 weeks ago


    Bangalore/Noida, IN Xperthunt Full time

    About the Role :We're seeking a highly skilled Data Engineer to join our team and play a pivotal role in building and maintaining our data infrastructure.You'll collaborate closely with data scientists, analysts, and stakeholders to understand their data needs and design, develop, and implement data solutions that empower effective analysis and...

  • Cloud Data Engineer

    4 weeks ago


    Bangalore/Hyderabad/Chennai/Pune/Anywhere in India/Multiple Locations, IN Amk technologies Full time

    Job Description :We are seeking a talented and motivated Cloud Data Engineer to join our dynamic team.As a Cloud Data Engineer, you will be responsible for designing, implementing, and maintaining data pipelines and infrastructure on Azure Cloud Platform. You will work closely with cross-functional teams to ensure efficient data flow and integration across...

  • Data Engineer

    4 weeks ago


    Bangalore/Any Location, IN INSIGHT GLOBAL SOLUTIONS Full time

    Data Engineer Must Haves :- Bachelors Degree in science, technology, or another related field.- 3+ years of data engineering experience.- 3+ years of experience with Cloud platforms like GCP, Azure, Airflow.- 4+ years of data warehouse, relational database, and SQL experience.- 4+ years of supporting ETL process and job scheduling experience.- 3+ years of...

  • GCP Developer

    1 week ago


    Bangalore/Pune/Noida/Hyderabad/Chennai, IN Nilasu consulting Full time

    JOB DESCRIPTION:Must Have: - Min 3 years' Experience with Building Pipelines using GCP-Big-Query - Min 2-3 Experience in working on Large Scale Data warehouses like Teradata - Experience building and optimizing data warehousing data pipelines (ELT and ETL), architectures and data sets. - Advanced working SQL knowledge and experience working with...

  • Lead Data Engineer

    4 weeks ago


    Bangalore/Hyderabad/Pune, IN iMind Your Business Solutions Private Limited Full time

    Job Description :We are hiring Lead Data Engineers for the leaders In Analytics & Cloud Applications, headquartered in San Francisco and have offices in India (Bangalore, Hyderabad and Pune)Our client provides strategic guidance and technology systems for clients wishing to solve their most complex and interesting business challenges involving cloud...

  • Senior Data Engineer

    4 weeks ago


    Hyderabad/Pune/Bangalore, IN iMind Your Business Solutions Private Limited Full time

    Job Description :We are hiring Data Engineers for the leaders In Analytics & Cloud Applications, headquartered in San Francisco and have offices in India (Bangalore, Hyderabad and Pune).Our client provides strategic guidance and technology systems for clients wishing to solve their most complex and interesting business challenges involving cloud...

  • Lead Data Engineer

    17 hours ago


    Chennai/Cochin/Kochi/Coimbatore/Hyderabad, IN DigiMoksha Solutions Full time

    Position : Lead Data EngineerExperience : 10-15 YearsLocation : Period : Immediate Description :As a Lead Data Engineer, you will play a crucial role in designing, developing, and maintaining our data infrastructure. You will lead a team of data engineers to ensure the successful delivery of projects and contribute to the overall data strategy. The ideal...

  • Senior Data Engineer

    4 weeks ago


    Bangalore/Chennai/Madurai, IN Resourcetree Full time

    Job Description : As a Senior MDM Data Engineer with hands-on experience in Informatica Cloud MDM, you will be responsible for leading and executing end-to-end master data management (MDM) initiatives within our organization. Leveraging your deep technical expertise and practical experience, you will drive the design, implementation, and optimization of MDM...

  • AWS Data Engineer

    2 weeks ago


    Bangalore/Pune/Hyderabad, IN Kezan Consulting Full time

    Company Overview : Kezan Consulting is a leading provider of Human Resources Services in the industry. We specialize in providing comprehensive HR solutions to our clients, helping them achieve their goals and drive business success. With a team of highly skilled professionals and a commitment to delivering excellence, we have established ourselves as a...

  • Tiger Analytics

    4 weeks ago


    Chennai/Bangalore/Hyderabad, IN Tiger Analytics Full time

    Job Description :- Strong hands-on experience in implementing data lake using technologies such as Databricks Spark, Data Factory, Azure Data Lake- Strong programming skills in Python/Scala, Pyspark, SQL- Expertise in implementing design for data ingestion, data transformation, handling data source using batch processing, deriving metrics, applying data...