Big Data Engineer

3 weeks ago


Jaipur, India ATech Full time

Hiring For Big Data Engineer (Spark, Scala, AWS)

Job description :

- Spark, SCALA, AWS OR Spark, python with AWS lambda exposure.

- Design, build, optimize and support new and existing data models and ETL processes based on our clients business requirements.

- Build, deploy and manage data infrastructure that can adequately handle the needs of a rapidly growing data driven organization.

- Coordinate data access and security to enable data scientists and analysts to easily access to data whenever they need too.

- Solid hands-on and Solution Architecting experience in Big-Data Technologies (AWS)

- Hands on experience in: AWS Dynamo DB, EKS, Kafka, Kinesis, Glue, EMR

- Hands-on experience of programming language like Scala with Spark.

- Good command and working experience on Hadoop Map Reduce, HDFS, Hive, HBase, and/or No-SQL Databases

- Hands on working experience on any of the data engineering analytics platform (Hortonworks Cloudera MapR AWS), AWS preferred

- Hands-on experience on Data Ingestion Apache Nifi, Apache Airflow, Sqoop, and Oozie

- Hands on working experience of data processing at scale with event driven systems, message queues (Kafka FlinkSpark Streaming)

- Hands on working Experience with AWS Services like EMR, Kinesis, S3, CloudFormation, Glue, API Gateway, Lake Foundation

Technical skills requirements :

- Hands on working Experience with AWS Athena

- Data Warehouse exposure on Apache Nifi, Apache Airflow, Kylo

- Operationalization of ML models on AWS (e.g. deployment, scheduling, model monitoring etc.)

- Feature Engineering Data Processing to be used for Model development

- Experience gathering and processing raw data at scale (including writing scripts, web scraping, calling APIs, write SQL queries, etc.)

- Experience building data pipelines for structured unstructured, real-time batch, events synchronous asynchronous using MQ, Kafka, Steam processing

- Hands-on working experience in analysing source system data and data flows, working with structured and unstructured data


- Must be very strong in writing SQL queries

- Strengthen the Data engineering team with Big Data solutions

- Strong technical, analytical, and problem-solving skills

- Strong organizational skills, with the ability to work autonomously as well as in a team-based environment - Pleasant Personality, Strong Communication & Interpersonal Skills.

(ref:hirist.tech)
  • Big data Full-Time

    4 weeks ago


    Jaipur, India HyreFox Consultants Full time

    POSITION: Big Data EngineerUST Global islooking for an active person who can work as Big Data Engineer in USTPlatforms. The candidate must possess excellent written and verbalcommunication skills with the ability to collaborate effectively with domainand technical experts in the organization.Primary skills:Apache Hadoop, Apache Spark, Apache KafkaRoles &...

  • Big data Full-Time

    1 month ago


    jaipur, India HyreFox Consultants Full time

    POSITION: Big Data Engineer UST Global islooking for an active person who can work as Big Data Engineer in USTPlatforms. The candidate must possess excellent written and verbalcommunication skills with the ability to collaborate effectively with domainand technical experts in the organization. Primary skills:  Apache Hadoop, Apache Spark, Apache...

  • Managing Consultant

    4 weeks ago


    Jaipur, India HyreFox Consultants Full time

    Lead end to end successful delivery of Big data use cases. Lead the team of Big Data architects and developers to deliver the solutionoutcome, with emphasis on value delivery. Get involved in meetings and discussions, by providing Point-of- Views and conducting Proof-of- Concepts leading to creating a use case for implementing big data...

  • Managing Consultant

    1 month ago


    jaipur, India HyreFox Consultants Full time

    Lead end to end successful delivery of Big data use cases.  Lead the team of Big Data architects and developers to deliver the solution outcome, with emphasis on value delivery.  Get involved in meetings and discussions, by providing Point-of- Views and conducting Proof-of- Concepts leading to creating a use case for implementing big data...

  • Sr Consultant

    4 weeks ago


    Jaipur, India HyreFox Consultants Full time

    Participate in various technology assessments (for example Hadoop, Spark, Kafka, TensorFlow, etc.) Active interaction with other departments to set up and configure big data clusters and assist their datalake onboarding. Participate in the design, implementation and documentation of new use cases Any other work assigned, as per the project...

  • Sr Consultant

    1 month ago


    jaipur, India HyreFox Consultants Full time

    Participate in various technology assessments (for example Hadoop, Spark, Kafka, TensorFlow, etc.)  Active interaction with other departments to set up and configure big data clusters and assist their datalake onboarding.  Participate in the design, implementation and documentation of new use cases  Any other work assigned, as per the project...

  • AU Small Finance Bank

    2 weeks ago


    Jaipur/Rajasthan, India Au Finance Bank Full time

    Spark Engineer Design and Develop Spark Applications:- Understand the current Apache Spark platform code and nuances related to the same- Optimize and fine-tune Spark jobs for performance and efficiency.2. Python Programming:- Utilize Python for scripting, data manipulation, and integration with Spark applications.- Collaborate with cross-functional teams...


  • Jaipur, India HyreFox Consultants Full time

    Qualification– B.Tech OR equivalent qualificationJob Description:• Expand and optimize our data ecosystem.• Designing the state-of-the-art data landscape using the modern age cloud components.• Strong understanding of Big Data Analytics platforms and ETL in the context of Big Data.• Frame architectural decisions, provide technology leadership &...

  • Big Data Engineer

    3 weeks ago


    Rajasthan,Karnataka,Metros,Jaipur,Udaipur,Bangalore,Raipur, India ATech Full time

    Hiring For Big Data Engineer (Spark, Scala, AWS)Job description :- Spark, SCALA, AWS OR Spark, python with AWS lambda exposure.- Design, build, optimize and support new and existing data models and ETL processes based on our clients business requirements.- Build, deploy and manage data infrastructure that can adequately handle the needs of a rapidly growing...

  • Big Data Engineer

    3 weeks ago


    Rajasthan/Karnataka/Metros/Jaipur/Udaipur/Bangalore/Raipur, IN ATech Full time

    Hiring For Big Data Engineer (Spark, Scala, AWS)Job description :- Spark, SCALA, AWS OR Spark, python with AWS lambda exposure.- Design, build, optimize and support new and existing data models and ETL processes based on our clients business requirements.- Build, deploy and manage data infrastructure that can adequately handle the needs of a rapidly growing...


  • jaipur, India HyreFox Consultants Full time

    Qualification – B.Tech OR equivalent qualification Job Description: • Expand and optimize our data ecosystem. • Designing the state-of-the-art data landscape using the modern age cloud components. • Strong understanding of Big Data Analytics platforms and ETL in the context of Big Data. • Frame architectural decisions, provide...

  • Big Data Engineer

    4 weeks ago


    Goa/Mumbai/Jammu & Kashmir/Jammu/Srinagar/Pondicherry/Jaipur/Lucknow/Varanasi/Banaras/Patna/Ranchi, IN ATech Full time

    Designation: BIG DATA ENGINEERJob Description:Your Role and Responsibilities:- Understand a data warehousing solution and able to work independently in such an environment- Responsible in Project development and delivery experience of a few good size projects- Design, build, optimize and support new and existing data models and ETL processes based on our...

  • Big Data Engineer

    2 weeks ago


    Goa/Mumbai/Jammu & Kashmir/Jammu/Srinagar/Pondicherry/Jaipur/Lucknow/Varanasi/Banaras/Patna/Ranchi, India ATech Full time

    Designation: BIG DATA ENGINEERJob Description:Your Role and Responsibilities:- Understand a data warehousing solution and able to work independently in such an environment- Responsible in Project development and delivery experience of a few good size projects- Design, build, optimize and support new and existing data models and ETL processes based on our...

  • Senior Data Analyst

    4 weeks ago


    Jaipur, India Sanmax Technologies (P) Limited Full time

    Job DescriptionThis Senior Data Engineer will need to have a successful history of data analysis, design, implementation and production deployment in critical, multi-business environments. This role will work closely with various Digital Product Insights, Analytics, Intelligence, Operations and Support teams in a highly collaborative environment to...

  • Senior Data Analyst

    1 month ago


    jaipur, India Sanmax Technologies (P) Limited Full time

    Job Description This Senior Data Engineer will need to have a successful history of data analysis, design, implementation and production deployment in critical, multi-business environments. This role will work closely with various Digital Product Insights, Analytics, Intelligence, Operations and Support teams in a highly collaborative...

  • Senior Data Analyst

    1 month ago


    Jaipur, India Sanmax Technologies (P) Limited Full time

    Job Description This Senior Data Engineer will need to have a successful history of data analysis, design, implementation and production deployment in critical, multi-business environments. This role will work closely with various Digital Product Insights, Analytics, Intelligence, Operations and Support teams in a highly collaborative environment to...

  • Data Architect

    2 weeks ago


    jaipur, India Programmers.io Full time

    Data Solutions Architect Ability to Conduct Client Workshops and participation in Due Diligence exercises to define a Data Strategy & roadmap that is aligned to their Business & IT Strategy • Heavy pre-sales involvement, right from qualifying the pursuit, to Lead the Pursuit, Collate Questionnaire, collaborate team for responses, conduct review sessions...

  • Data Architect

    2 weeks ago


    Jaipur, India Programmers.io Full time

    Data Solutions Architect Ability to Conduct Client Workshops and participation in Due Diligence exercises to define a Data Strategy & roadmap that is aligned to their Business & IT Strategy• Heavy pre-sales involvement, right from qualifying the pursuit, to Lead the Pursuit, Collate Questionnaire, collaborate team for responses, conduct review sessions...

  • Senior Engineer

    3 days ago


    Jaipur, India Altimetrik Full time

    Experiance - 4+ yrsPrimery Skills - Data Science, Machine Learning, SQLSecondary Skills - SQL, PythonQualifications:Bachelor’s degree in a related field, such as computer science, software engineering or data science, is recommended. Master’s degree in Artificial Intelligence a plus4+ years of experience working in AI /Machine Learning Engineering...


  • Jaipur, India HyreFox Consultants Full time

    Humanli.AI isa Startup founded by Alumnus of IIM' Bangalore/ISB Hyderabad & IIM'Calcutta. We are democratizing and extending technology that were accessible& consumed only by MNC’s or Fortune companies to SME and Mid-size firms. Weare pioneers in bringing Knowledge Management algorithms & Computer Visioninto Conversational BOT framework. All our Bot’s...