Big Data Engineer

2 months ago


Indore, India NucleusTeq Consulting Pvt. Ltd. Full time

We are looking for a Big Data Engineer that will work on the collecting, storing, processing, and analyzing of huge sets of data. The primary focus will be on choosing optimal solutions to use for these purposes, then maintaining, implementing, and monitoring them. You will also be responsible for integrating them with the architecture used across the company.

Mandatory Skills: Scala, Spark, AWS Services

Responsibilities :

- Selecting and integrating any Big Data tools and frameworks required to provide requested capabilities

- Implementing ETL process

- Monitoring performance and advising any necessary infrastructure changes

- Defining data retention policies.


Skills and Qualifications :

- Proficient understanding of distributed computing principles.

- Management of Hadoop cluster, with all included services.

- Ability to solve any ongoing issues with operating the cluster.

- Proficiency with Hadoop v2, MapReduce, HDFS.

- Good knowledge of Big Data querying tools, such as Pig, Hive, and Impala

- Experience with Spark.

- Experience with integration of data from multiple data sources.

- Experience with NoSQL databases, such as HBase, Cassandra, MongoDB.

- Experience with various messaging systems, such as Kafka or RabbitMQ.

- Good understanding of Lambda Architecture, along with its advantages and drawbacks.

(ref:hirist.tech)
  • Big Data Engineer

    3 weeks ago


    Indore, India NucleusTeq Consulting Pvt. Ltd. Full time

    Job Title: Big Data EngineerWe are seeking a highly skilled Big Data Engineer to join our team at NucleusTeq Consulting Pvt. Ltd. The ideal candidate will have a strong background in distributed computing and experience with Big Data tools and frameworks.Key Responsibilities:Select and integrate Big Data tools and frameworks to provide requested...


  • Indore, Madhya Pradesh, India NucleusTeq Full time

    Big Data Engineer Responsibilities:Lead a team of engineers with 5+ years of experience in Big Data engineering.Strong expertise in Spark, Scala/Java, Airflow Orchestration, and AWS.Collaborate with software research and development teams to finalize system scope and deliver Big Data solutions.Train staff on data resource management and engineering best...

  • Big Data Engineer

    1 month ago


    Indore, Madhya Pradesh, India NucleusTeq Consulting Pvt. Ltd. Full time

    We are looking for a Big Data Engineer that will work on the collecting, storing, processing, and analyzing of huge sets of data. The primary focus will be on choosing optimal solutions to use for these purposes, then maintaining, implementing, and monitoring them. You will also be responsible for integrating them with the architecture used across the...

  • Data Engineer

    3 weeks ago


    Indore, India Golden Eagle IT Technologies Pvt Ltd. Full time

    Job Title: Data EngineerLocation: Indore, Madhya PradeshCompany: Golden Eagle IT Technologies Pvt. Ltd.Job Description:We are seeking a skilled Data Engineer to join our team in Indore. The ideal candidate will have a strong background in data engineering, big data technologies, and cloud platforms. You will work on designing, building, and maintaining...


  • Indore, Madhya Pradesh, India Big Sky Manpower Solution Full time

    We are seeking an experienced Electrical Engineer to join our team at Big Sky Manpower Solution.Key Responsibilities:Design and implement complex electrical systems for commercial and industrial applications.Maintain and improve electrical instruments, facilities, and equipment.Operate computer-assisted design software and equipment to perform a wide range...

  • Data Engineer

    4 months ago


    Indore, Madhya Pradesh, India Golden Eagle IT Technologies Pvt Ltd. Full time

    Job Title : Data Engineer (2-4 Years Experience)Location : Indore, Madhya PradeshCompany : Golden Eagle IT Technologies Pvt. Ltd.Job Description :Golden Eagle IT Technologies Pvt. Ltd. is seeking a skilled Data Engineer with 2 to 4 years of experience to join our team in Indore. The ideal candidate will have a strong background in data engineering, big data...

  • Data Engineer

    3 months ago


    Indore, India Golden Eagle IT Technologies Pvt Ltd. Full time

    Job Title : Data Engineer (2-4 Years Experience)Location : Indore, Madhya PradeshCompany : Golden Eagle IT Technologies Pvt. Ltd.Job Description :Golden Eagle IT Technologies Pvt. Ltd. is seeking a skilled Data Engineer with 2 to 4 years of experience to join our team in Indore. The ideal candidate will have a strong background in data engineering, big data...


  • Indore, India NucleusTeq Consulting Pvt. Ltd. Full time

    We are seeking a highly skilled Big Data Engineer to design, implement, and maintain large-scale data processing systems. The ideal candidate will have a strong understanding of distributed computing principles and experience with handling massive datasets.Key Responsibilities:Select and integrate Big Data tools and frameworks to meet business...


  • Indore, India NucleusTeq Consulting Pvt. Ltd. Full time

    We are seeking a highly skilled Data Engineering Specialist to join our team at NucleusTeq Consulting Pvt. Ltd. The ideal candidate will have expertise in designing, implementing, and maintaining large-scale data processing systems.Key Responsibilities:Selecting and integrating Big Data tools and frameworks to meet business requirementsImplementing ETL...

  • Data Engineer

    1 week ago


    Indore, India Golden Eagle IT Technologies Pvt Ltd. Full time

    Data Engineer Position DescriptionJob Summary:Golden Eagle IT Technologies Pvt. Ltd. is seeking a skilled Data Engineer to design, build, and maintain efficient, scalable, and reliable data pipelines. This role involves utilizing tools like Apache Airflow, Spark, and Hadoop for ETL pipeline development and maintenance. Additionally, the successful candidate...

  • Data Engineer

    2 weeks ago


    Indore, Madhya Pradesh, India NucleusTeq Full time

    Job Title: Data Engineer - AWSJob Summary:We are seeking a highly skilled Data Engineer to join our team at NucleusTeq. As a Data Engineer, you will be responsible for designing and building data models to support business requirements, developing and maintaining data ingestion and processing systems, and implementing data storage solutions.Key...


  • Indore, India Robro Systems Full time

    Company Description All industrial processes require inspection to ensure product quality. Robro Systems develops camera-based inspection and monitoring solutions that are significantly more accurate than manual inspection, reducing error rates by more than 95%. These artificial intelligence systems generate wealth of data regarding quality, productivity and...


  • Indore, India Robro Systems Full time

    Company Description All industrial processes require inspection to ensure product quality. Robro Systems develops camera-based inspection and monitoring solutions that are significantly more accurate than manual inspection, reducing error rates by more than 95%. These artificial intelligence systems generate wealth of data regarding quality, productivity and...


  • Indore, India Lancesoft India Pvt Ltd Full time

    Job Title : Azure Databricks Data EngineerLocation : RemoteJob Type : Full TimeExperience Level : 6-12 YearsJob Description :Lancesoft India Pvt Ltd is seeking an experienced Azure Databricks Data Engineer to develop, optimize, and maintain data pipelines and ETL processes using Azure Databricks and PySpark.Key Responsibilities :- Develop scalable data...


  • Indore, Madhya Pradesh, India Big Sky Manpower Solution Full time

    Electrical Engineer Job DescriptionWe are seeking a skilled Electrical Engineer to design and implement complex electrical systems for industrial, commercial, and domestic purposes.Key Responsibilities:Develop and maintain electrical systems, ensuring compliance with industry standards and customer requirements.Design, implement, and improve electrical...


  • Indore, Madhya Pradesh, India NucleusTeq Full time

    **Job Description**NucleusTeq seeks a highly skilled Data Engineer with expertise in Google Cloud Platform (GCP) to drive business success and digital innovation. The ideal candidate will have a strong background in data engineering, data modeling, and data migration, with experience in ETL processes, data warehousing, and data analytics.**Key...


  • Indore, Madhya Pradesh, India Engineer Sahab Full time

    **Job Description - Engineer Sahab** **Job title**:Digital Marketing Intern **Experience **:Fresher **Location**:Indore **Terms**:Full time **About us**:Engineer Sahab is a leading and highly innovative IT company that caters to offshore Web and Mobile App Development. Our committed teams have a unique blend of functional and operational knowledge,...


  • Indore Cloth Market, India Robro Systems Full time

    Company Description All industrial processes require inspection to ensure product quality. Robro Systems develops camera-based inspection and monitoring solutions that are significantly more accurate than manual inspection, reducing error rates by more than 95%. These artificial intelligence systems generate wealth of data regarding quality, productivity and...

  • Data Modeller

    5 months ago


    Indore, India TEANSOFT Full time

    Mandatory experience in Advance Data & Analytics Architecture, ETL, Data Engineering solution using the following Skills, tools and technologies: AWS Data & Analytics Services: Athena, Glue, DynamoDB, Redshift Databricks Lakehouse Platform PySpark, Spark SQL, Experience with any NoSQL Database Expert-level skills in writing and optimizing SQL. Experience...

  • Senior Data Architect

    24 hours ago


    Indore, Madhya Pradesh, India NucleusTeq Full time

    Key ResponsibilitiesDesign and Build Data ModelsDevelop and maintain data ingestion and processing systems to support business requirements.Implement Data Storage SolutionsDesign and implement data storage solutions, including databases and data lakes, to ensure data consistency and accuracy.Collaborate with Cross-Functional TeamsWork with cross-functional...