Big Data Engineer

3 days ago


Anywhere in IndiaMultiple Locations TalentXO Full time

Required Qualifications :


- 7-8 years of experience as a Data Engineer or in a similar role


- Proficient in Python programming and PySpark for data processing and transformation


- Extensive experience in designing and implementing data pipelines using AWS Glue and AWS MWAA (Airflow)


- Strong SQL skills, including experience with AWS Redshift


- Familiarity with data warehousing concepts and best practices


- Hands-on experience in cloud-based data infrastructure, preferably AWS


- Ability to work collaboratively with cross-functional teams and stakeholders


- Strong problem-solving, analytical, and troubleshooting skills


- Experience in data governance and data quality Qualifications :


- Experience with other big data technologies (e.g., Kafka, Spark, Hadoop)


- Knowledge of data modeling and dimensional modeling techniques


- Familiarity with machine learning and data science workflows


- Proven track record of delivering high-impact data engineering projects


- Excellent communication and presentation skills


(ref:hirist.tech)

  • Anywhere in India/Multiple Locations US Technology International Pvt Ltd Full time

    Job Title: Senior Big Data EngineerJob Summary:US Technology International Pvt Ltd is seeking a Senior Big Data Engineer to lead the development and implementation of big data solutions. The ideal candidate will have expertise in Hadoop, Spark, and other big data technologies, as well as strong leadership and communication skills.Key Responsibilities:Design,...

  • Big Data Engineer

    7 days ago


    Anywhere in India/Multiple Locations D-TechWorks Pvt Ltd Full time

    We are looking for Aws big data engineer In Remote , India Position : Aws big data engineerExperience : 7 to 9 YearLocation : Remote , India Mandate skills : BigData Python Pyspark AWS Glue Airflow Redshift Responsibilities :- Ensure effective Design, Development, Validation and Support activities in line with client needs and architectural requirements.,-...

  • Big Data Engineer

    1 month ago


    Anywhere in India/Multiple Locations IT Source Global Full time

    Job SummaryWe are seeking a skilled Hadoop Developer to join our team at IT Source Global. As a Hadoop Developer, you will be responsible for designing and developing complex data pipelines for ingestion, transformation, and processing of structured and unstructured data.Key ResponsibilitiesDevelop, implement, and maintain large-scale data processing...


  • Anywhere in India/Multiple Locations D-TechWorks Pvt Ltd Full time

    About the RoleWe are seeking an experienced Senior Big Data Engineer for Cloud Migration to join our team at D-TechWorks Pvt Ltd.Job SummaryThe ideal candidate will have 7-9 years of experience in leading big data engineering projects using AWS, Azure, or GCP. They should be proficient in BigData Python, PySpark, AWS Glue, Airflow, and Redshift.Key...

  • Lead Data Engineer

    2 days ago


    Anywhere in India/Multiple Locations Talentoj Full time

    Requirements : - 6+ years' experience with Big Data Technologies such as Apache Spark, Cloud Native, and Data Lakes, and Databricks. - Delivered ETL/ELT solutions including data extraction, transformation, cleansing, data integration, and data management. - Implemented batch ingestion pipelines. - Strong Python skills - automate tasks, write...


  • Anywhere in India/Multiple Locations IT Source Global Full time

    Job Description:As a Senior Big Data Architect at IT Source Global, you will play a key role in designing and developing large-scale data pipelines using cutting-edge technologies such as Py Spark, Python, and SQL. Your expertise will be instrumental in architecting scalable data lakes, data warehouses, and data marts that meet the evolving needs of our...

  • Big Data Engineer

    1 month ago


    Anywhere in India/Multiple Locations/Remote Hum Technologies Full time

    Big Data Engineer with strong exp in Hadoop, Spark, SQL & AWS for one of the Fortune 500 Clients Company Name : Hum TechnologiesClient : One of the Fortune 500 CompaniesLocation : : Apache NiFi, HDFS, Hive, Impala, Spark, Spark Streaming, Kafka, Java/Scala, SQL, Shell scripting Roles & Responsibilities : - Responsible for designing and implementing...


  • Anywhere in India/Multiple Locations US Technology International Pvt Ltd Full time

    Job Description : Responsibilities : 1. Explain and communicate the design / development to the customer 2. Perform and evaluate test results against product specifications 3. Break down complex problems into logical components 4. Develop user interfaces business software components 5. Use data models 6. Estimate time and effort required for...


  • Anywhere in India/Multiple Locations Aexonic Technologies Private Limited Full time

    Key Responsibilities :- Design, develop, and optimize Big Data pipelines and workflows using Hadoop, Hive, PySpark, and Google BigQuery.- Architect data solutions to facilitate smooth data migration and processing between on-premises systems and Google Cloud Platform (GCP).- Create and manage Unix Shell Scripts for process automation and data handling...

  • Data Engineer

    1 week ago


    Anywhere in India/Multiple Locations Orangeskill Technologies Pvt Ltd Full time

    Job Description :We are looking for a talented and experienced Data Engineer to join our team. You will be responsible for designing, building, and maintaining data pipelines, workflows, and infrastructure to support efficient data processing and analysis. The ideal candidate will have experience in workflow orchestration tools, database management, data...

  • Data Engineer

    1 week ago


    Metros/Anywhere in India/Multiple Locations One of the Consulting Firms Full time

    Data Engineer (Python & SQL)Position : Data Engineer (Python & SQL)Locations : Hyderabad, Chennai, Bengaluru, Mumbai, Pune, Kolkata, GurugramJob Type : Full-TimeCompany : Reputed Big 4 MNC client company of Live Connections.Role Overview :We are looking for a skilled Data Engineer with experience in Python, SQL, and Financial Services Industry (FSI) to join...

  • Cloud Data Engineer

    15 hours ago


    Anywhere in India/Multiple Locations Excelra Knowledge Solutions Full time

    Job Description:Data engineers with expertise in ontologies, cloud platforms, and data technologies are sought after to build scalable data pipelines. The role involves designing, implementing, and managing cloud-based solutions on AWS and Azure.Key Responsibilities:Design and implement cloud infrastructure on AWS and AzureDevelop and optimize data pipelines...


  • Anywhere in India/Multiple Locations/Remote NucleusTeq Consulting Pvt. Ltd. Full time

    Big Data Engineer RoleAs a seasoned Big Data Engineer at NucleusTeq Consulting Pvt. Ltd., you will be responsible for leading a team of engineers and driving the implementation of big data solutions. - You will have 5-6 years of experience in big data engineering and a strong exposure to Spark, Scala/Java, Airflow Orchestration, and AWS. - Your expertise...

  • Data Engineer

    1 week ago


    Anywhere in India/Multiple Locations Crescendo Global Full time

    Job Description : Are you an experienced Data Engineer with expertise in Python, Pyspark, and AWS? Our client, a leading technology firm in India, is looking for a Senior Data Engineer to join their team. If you have a strong analytical mindset and a passion for leveraging data to drive business insights, this opportunity is perfect for you.Location : PAN...


  • Anywhere in India/Multiple Locations Excelra Knowledge Solutions Full time

    Data Engineer (Cloud & Ontologies)Job Description : Excelra is hiring for experienced Data Engineer with expertise in ontologies, AWS, Azure, and various data technologies. The role involves building and maintaining scalable data pipelines, working with cloud platforms, and supporting server and application deployment.Roles and Responsibilities : - Cloud...


  • Anywhere in India/Multiple Locations/Hyderabad/Srinagar/Jaipur Aricent Full time

    **Job Title:** Big Data Solutions Architect**Job Description:**At Aricent, we are looking for a skilled Data Engineer to design and build large-scale Hadoop and NoSQL database solutions for our Fortune 500 clients. The ideal candidate will have extensive experience in PySpark and the ability to integrate data across internal and external sources, providing...

  • Big Data Engineer

    3 weeks ago


    India Pert Telecom Solutions Full time

    Job Description : We are seeking a skilled Big Data Engineer with deep expertise in PySpark, Python, MySQL, Hadoop and Linux. The ideal candidate should have extensive experience deploying and managing these tools within on-premises environments (no public cloud). Proficiency in cluster management, performance optimization, and monitoring is essential...

  • Data Engineer

    1 week ago


    Anywhere in India/Multiple Locations Innotatz IT Solutions Full time

    Job Description : We are looking for candidates who can join immediately. InnotatzIT Solutions is a global Software Development, IT Product Design and IT Consulting Company predominantly focused on Web Application Development, Digital Innovations & IT Recruitment Solutions. We also provide global digital consultancy that helps brands leverage design,...

  • Data Engineer

    2 days ago


    Anywhere in India/Multiple Locations Info Services Full time

    Responsibilities :- Data Ingestion & Processing : Design and implement efficient data pipelines using big data frameworks (e.g, Spark) for ingesting, transforming, and processing large datasets.- Programming Powerhouse : Utilize your strong coding skills in Scala (preferred), Python, or Java to develop high-performance and scalable data processing...

  • Azure Data Engineer

    1 month ago


    Anywhere in India/Multiple Locations Prep Full time

    Job Description : The ideal candidate will design, architect, and develop end-to-end data solutions on the Azure Stack platform. They will implement and optimize data pipelines, ETL processes, and data integration solutions using Azure Data Factory, Azure Data Lake, Azure Databricks, Azure SQL Database, and other relevant Azure services. Collaboration with...