Big Data Engineer

1 week ago


Anywhere in IndiaMultiple Locations Spruce IT Pvt. Ltd. Full time

Responsibilities :

- Design, develop, and implement robust big data pipelines and ETL processes using Hadoop and PySpark.

- Perform data analysis, transformation, and cleansing to extract valuable insights.

- Optimize performance and scalability of big data applications.

- Collaborate with data scientists and analysts to understand data requirements and translate them into technical solutions.

- Stay up-to-date with the latest advancements in big data technologies and trends.

- Troubleshoot and resolve complex data-related issues.

Qualifications :

- 5+ years of experience in big data engineering and development.

- Strong proficiency in Hadoop, PySpark, and related technologies.

- In-depth understanding of big data concepts, including data ingestion, processing, and analysis.

- Experience with data warehousing and data lakes.

- Knowledge of SQL and NoSQL databases.

- Excellent problem-solving and analytical skills.

- Strong communication and collaboration skills

(ref:hirist.tech)
  • Big Data Engineer

    1 week ago


    Anywhere in India/Multiple Locations AEXONIC TECHNOLOGIES PRIVATE LIMITED Full time

    Position : Sr Big Data Engineer (GCP)Experience : 5 to 8 YrsLocation : Remote Shift Time : EST Shift (5:30 PM to 2:30 AM)Position Overview : We are seeking a highly skilled Senior Big Data Engineer with extensive experience in Big Data technologies, including Hadoop, Hive, PySpark, and expertise in Google Cloud Platform (GCP) and BigQuery. The successful...


  • Anywhere in India/Multiple Locations AJ Consulting Full time

    About the RoleThe Lead Big Data Engineer - AI Consulting will be responsible for leading a team of data engineers in the design and implementation of big data solutions using PySpark. This role requires expertise in PySpark, Hadoop, Hive, and Spark, as well as strong leadership and collaboration skills.You will work closely with cross-functional teams to...


  • Anywhere in India/Multiple Locations/Bangalore Lakshya Software Technologies Private Limited Full time

    About the Role : We are seeking a highly skilled and experienced Cloud Big Data Engineer to join our growing team. In this role, you will be responsible for designing, developing, and maintaining robust and scalable data pipelines and applications on the cloud. You will work with large datasets, leveraging big data technologies to extract meaningful...


  • Anywhere in India/Multiple Locations/Remote NucleusTeq Consulting Pvt. Ltd. Full time

    Role : Big Data Engineer Responsibilities :- Big Data Engineer with 5-6 years of experience- Experience in leading a team of engineers and a good attitude toward learning the domain and implementation- Strong exposure and expertise in Spark (Primary), Scala/Java (Scala Primary), Airflow Orchestration and AWS.- Finalizing the scope of the system and...


  • Anywhere in India/Multiple Locations AEONOVATECH PRIVATE LIMITED Full time

    Key Responsibilities :- Lead and mentor a team of Big Data Engineers.- Participate in the design and implementation of the big data analytics architecture on Azure.- Develop and implement big data pipelines using Spark Scala and Python.- Write complex Hive queries to extract valuable insights from data lakes.- Collaborate with cross-functional teams (QA,...


  • Anywhere in India/Multiple Locations AJ Consulting Full time

    Job DescriptionWe are looking for a highly experienced Big Data Solutions Lead to join our team at AJ Consulting. In this role, you will be responsible for designing and implementing scalable and robust data pipelines using PySpark.You will also ensure data accuracy and integrity by implementing data validation and quality checks, and mentor and coach team...


  • Anywhere in India/Multiple Locations/Bangalore Lakshya Software Technologies Private Limited Full time

    About the Role : We are seeking a highly skilled and experienced Cloud Big Data Engineer to join our growing team. In this role, you will be responsible for designing, developing, and maintaining robust and scalable data pipelines and applications on the cloud. You will work with large datasets, leveraging big data technologies to extract meaningful...

  • Engineering Lead

    1 week ago


    Anywhere in India/Multiple Locations Spruce IT Pvt. Ltd. Full time

    We are seeking an experienced Engineering Lead - Data Processing to lead our efforts in building and maintaining cutting-edge big data processing systems. As a key member of our engineering team, you will be responsible for overseeing the design, implementation, and maintenance of our big data infrastructure, ensuring seamless integration with existing...

  • Big Data Developer

    2 weeks ago


    Anywhere in India/Multiple Locations Populace World Solution Full time

    Job Description : - Strong experience with big data technologies and associated tools such as Hadoop, Unix, HDFS, Hive, Impala, etc. - Proficient in using Spark/Scala - Experience with data Import/Export using Sqoop or similar tools - Experience using Airflow, Jenkins or similar other automation tools - Excellent knowledge of SQL Server and database...

  • Data Engineer

    3 weeks ago


    Anywhere in India/Multiple Locations Patch Infotech Private Limited Full time

    Key Responsibilities : - Design, develop, and implement data pipelines to extract, transform, and load (ETL) data from various sources (databases, APIs, cloud storage, streaming platforms). - Develop and maintain data pipelines using tools like Apache Spark, Kafka, and other big data technologies.- Ensure data quality and integrity throughout the data...


  • Remote/Anywhere in India/Multiple Locations DXC Luxoft Full time

    Project Description : We've been engaged by an Investment Banking client in the Corporate, Commercial and Institutional Banking (CCIB) potfolio to work on the projects for managing analytics support for all the key initiatives of all segments/products. Responsibilities : - Choosing the right technologies for our use cases, deploy and operate. - Setting up...


  • Anywhere in India/Multiple Locations CYMETRIX INFOTECH PRIVATE LIMITED Full time

    **Overview:**CYMETRIX INFOTECH PRIVATE LIMITED is a cutting-edge technology company that provides innovative solutions for businesses. We are committed to helping organizations make data-driven decisions.**Job Title:**AWS Data Architect**About the Role:**We are seeking a seasoned AWS Data Architect to lead our data engineering team and develop scalable data...

  • Big Data Engineer

    4 days ago


    Remote/Anywhere in India/Multiple Locations Upraised Full time

    At Upraised, we are seeking a highly skilled Data Warehouse Architect to lead the design and development of our robust data infrastructure.This critical role is responsible for creating efficient data models and schema designs that support business intelligence and analytics needs. The ideal candidate will have hands-on experience in building, optimizing,...

  • Big Data Architect

    5 days ago


    Anywhere in India/Multiple Locations Insight Global Full time

    Job DetailsWe are seeking an experienced Data Engineer to join our team at Insight Global. This is a 100% remote position, allowing for flexibility and work-life balance. The ideal candidate will have strong proficiency in Python and SQL, as well as experience with data visualization tools such as Tableau or Looker.Responsibilities:Build, maintain, and scale...


  • Anywhere in India/Multiple Locations Sureminds Full time

    **Required Skills and Qualifications**To be successful in this role, you will need to possess the following skills and qualifications:Bachelor's degree in Engineering, Computer Science, Data Science, or related field3+ years of experience in software development, data science, data engineering, ETL, and analytics reporting developmentExperience designing,...

  • Data Engineer

    3 weeks ago


    Anywhere in India/Multiple Locations CA-One Tech Cloud Full time

    Job Description : Data Engineer (4+ Years Experience) Position : Data Engineer Location : Remote Employment Type : Full-time Experience : 4+ years Start Date : Immediate Job Overview : We are seeking a skilled and motivated Data Engineer to join our team. The ideal candidate will possess expertise in advanced technologies such as Python, RAG...

  • Data Engineer

    3 weeks ago


    Anywhere in India/Multiple Locations Sureminds Full time

    As a Senior Data Engineer, you will be responsible for building and supporting large-scale data architectures that provide information to downstream systems and business users. We are seeking an innovative and experienced individual who can aggregate and organize data from multiple sources to streamline business decision-making. In your role, you will...


  • Anywhere in India/Multiple Locations Cybyrotek Solutions Full time

    Job Title: Senior Data EngineerAbout Cybyrotek Solutions: We are a leading technology company that provides innovative data engineering solutions to its clients.The Job: We are seeking a highly skilled Senior Data Engineer to join our team. The ideal candidate will have expertise in designing, developing, and maintaining large-scale data pipelines and...

  • Cloud Data Engineer

    1 week ago


    Anywhere in India/Multiple Locations AEXONIC TECHNOLOGIES PRIVATE LIMITED Full time

    Key RequirementsTo be considered for this position, you must have:Minimum of 8 years of industry experience working with Big Data technologies.Proficiency in Hadoop, Hive, and PySpark for data processing.Strong experience with Unix Shell Scripting.Expertise in SQL and extracting data from multiple sources.Demonstrated experience in data analysis,...

  • Data Engineer

    4 weeks ago


    Anywhere in India/Multiple Locations RECRUTMENT Full time

    Required Skills and Qualifications :- Proficiency in Apache Spark for batch and streaming data processing.- Strong knowledge of orchestration tools like Apache Airflow.- Experience with big data frameworks and technologies (e.g., Hadoop, Kafka).- Familiarity with AWS data services such as Glue, Athena, and Kinesis.- Understanding of event-driven...