Big Data Engineer

3 weeks ago


RajasthanKarnatakaMetrosJaipurUdaipurBangaloreRaipur, India ATech Full time

Hiring For Big Data Engineer (Spark, Scala, AWS)

Job description :

- Spark, SCALA, AWS OR Spark, python with AWS lambda exposure.

- Design, build, optimize and support new and existing data models and ETL processes based on our clients business requirements.

- Build, deploy and manage data infrastructure that can adequately handle the needs of a rapidly growing data driven organization.

- Coordinate data access and security to enable data scientists and analysts to easily access to data whenever they need too.

- Solid hands-on and Solution Architecting experience in Big-Data Technologies (AWS)

- Hands on experience in: AWS Dynamo DB, EKS, Kafka, Kinesis, Glue, EMR

- Hands-on experience of programming language like Scala with Spark.

- Good command and working experience on Hadoop Map Reduce, HDFS, Hive, HBase, and/or No-SQL Databases

- Hands on working experience on any of the data engineering analytics platform (Hortonworks Cloudera MapR AWS), AWS preferred

- Hands-on experience on Data Ingestion Apache Nifi, Apache Airflow, Sqoop, and Oozie

- Hands on working experience of data processing at scale with event driven systems, message queues (Kafka FlinkSpark Streaming)

- Hands on working Experience with AWS Services like EMR, Kinesis, S3, CloudFormation, Glue, API Gateway, Lake Foundation

Technical skills requirements :

- Hands on working Experience with AWS Athena

- Data Warehouse exposure on Apache Nifi, Apache Airflow, Kylo

- Operationalization of ML models on AWS (e.g. deployment, scheduling, model monitoring etc.)

- Feature Engineering Data Processing to be used for Model development

- Experience gathering and processing raw data at scale (including writing scripts, web scraping, calling APIs, write SQL queries, etc.)

- Experience building data pipelines for structured unstructured, real-time batch, events synchronous asynchronous using MQ, Kafka, Steam processing

- Hands-on working experience in analysing source system data and data flows, working with structured and unstructured data


- Must be very strong in writing SQL queries

- Strengthen the Data engineering team with Big Data solutions

- Strong technical, analytical, and problem-solving skills

- Strong organizational skills, with the ability to work autonomously as well as in a team-based environment - Pleasant Personality, Strong Communication & Interpersonal Skills.

(ref:hirist.tech)
  • Big Data Engineer

    2 months ago


    Rajasthan,Karnataka,Metros,Jaipur,Udaipur,Bangalore,Raipur, India ATech Full time

    Hiring For Big Data Engineer (Spark, Scala, AWS)Job description :- Spark, SCALA, AWS OR Spark, python with AWS lambda exposure.- Design, build, optimize and support new and existing data models and ETL processes based on our clients business requirements.- Build, deploy and manage data infrastructure that can adequately handle the needs of a rapidly growing...

  • Big Data Engineer

    2 months ago


    Rajasthan/Karnataka/Metros/Jaipur/Udaipur/Bangalore/Raipur, IN ATech Full time

    Hiring For Big Data Engineer (Spark, Scala, AWS)Job description :- Spark, SCALA, AWS OR Spark, python with AWS lambda exposure.- Design, build, optimize and support new and existing data models and ETL processes based on our clients business requirements.- Build, deploy and manage data infrastructure that can adequately handle the needs of a rapidly growing...

  • Big Data Engineer

    4 weeks ago


    Rajasthan/Karnataka/Metros/Jaipur/Udaipur/Bangalore/Raipur, IN ATech Full time

    Hiring For Big Data Engineer (Spark, Scala, AWS)Job description :- Spark, SCALA, AWS OR Spark, python with AWS lambda exposure.- Design, build, optimize and support new and existing data models and ETL processes based on our clients business requirements.- Build, deploy and manage data infrastructure that can adequately handle the needs of a rapidly growing...

  • Big Data Engineer

    3 weeks ago


    bangalore, India Awign Expert Full time

    This is a remote position. Job Title: Big Data Solutions Engineer Reporting to: Director, Product Management Location: India (Remote) Our Ideal Candidate Our company is seeking a talented Big Data Solutions Engineer to join our team. The ideal candidate will be responsible for designing, developing, and implementing our proprietary...

  • Big Data Engineer

    4 weeks ago


    bangalore, India Awign Expert Full time

    This is a remote position. Job Title: Big Data Solutions Engineer Reporting to: Director, Product Management Location: India (Remote) Our Ideal Candidate Our company is seeking a talented Big Data Solutions Engineer to join our team. The ideal candidate will be responsible for designing, developing, and implementing our proprietary...


  • Jaipur, India Partech Full time

    Hi there! We’re PAR and our purpose is:To deliver solutions that connect people to the restaurants, meals and moments they love.We take that responsibility very seriously. As a leading provider of technology to the top restaurant brands in the world we’re calling all rebels, instigators, idealists and builders to join our constantly growing team!PAR...


  • jaipur, India Partech Full time

    Hi there! We’re PAR and our purpose is: To deliver solutions that connect people to the restaurants, meals and moments they love. We take that responsibility very seriously. As a leading provider of technology to the top restaurant brands in the world we’re calling all rebels, instigators, idealists and builders to join our constantly growing team! PAR...

  • Big Data Engineer

    1 day ago


    bangalore, India Adobe Full time

    Our Company Changing the world through digital experiences is what Adobe’s all about. We give everyone—from emerging artists to global brands—everything they need to design and deliver exceptional digital experiences! We’re passionate about empowering people to create beautiful and powerful images, videos, and apps, and transform how companies...

  • Big Data Engineer

    1 week ago


    bangalore, India Alp Consulting Limited Full time

    Big Data Engineer Duties & Responsibilities To write an effective big data engineer job description, begin by listing detailed duties, responsibilities and expectations. We have included big data engineer job description templates that you can modify and use. Sample responsibilities for this position include: You are responsible for Hadoop...

  • Big Data Engineer

    1 day ago


    bangalore, India Alp Consulting Limited Full time

    Senior Big Data Engineer Duties & Responsibilities To write an effective senior big data engineer job description, begin by listing detailed duties, responsibilities and expectations. We have included senior big data engineer job description templates that you can modify and use. Sample responsibilities for this position include: Performing...

  • Big Data Engineer

    2 days ago


    bangalore, India shreeniwas Full time

    Big Data Engineer Job Description: Data Scientist We are looking for a candidate with 6+ years of experience as a DATA ENGINEER, with education (Bachelors degree or higher) in Computer Science, Mathematics, or a related technical field, or equivalent practical experience. They should also have the following abilities: Required 1. Relevant Experience...

  • Solution Engineer

    2 days ago


    bangalore, India Coders Brain Technology & Private Limited Full time

    Big Data Solutions Engineer to join our team.The ideal candidate will be responsible for designing, developing, and implementing our proprietary Big Data-powered Fin Crime solution for our clients. The candidate will work closely with the software development team, data scientists, and product managers to understand requirements, configureand implement our...


  • Metros/Anywhere in India/Multiple Locations WEN Full time

    Role : Big Data + DatabricksResponsibilities : Design, develop, and implement scalable Big Data solutions using the Hadoop ecosystem. Work closely with data scientists and analysts to understand their requirements and translate them into technical solutions. Develop and optimize Spark and Hive scripts to process, transform, and analyze large datasets. Ensure...

  • Big Data Engineer

    1 week ago


    Mumbai/Pune/Bangalore, India Techno Wise Full time

    Job Description :We are seeking a talented Big Data Engineer proficient in PySpark to join our dynamic team. The ideal candidate will play a pivotal role in designing, implementing, and maintaining scalable data solutions leveraging the Big Data technologies like PySpark. This role requires a strong understanding of big data technologies, data engineering...

  • Big Data Engineer

    2 months ago


    bangalore, India Hexaware Technologies Full time

    Description Data Engineer: Primary : ADF, SQL Seconday : Databricks, Pyspark / Scala, CICD, Data Security, encryption Responsibilities: •Work closely with scrum master, technical leads and provide daily progress updates on the tasks assigned. •Provide support in defining the scope and sizing of the work. •Working closely with...

  • Big Data Engineer

    3 weeks ago


    bangalore, India Hexaware Technologies Full time

    Description Data Engineer: Primary : ADF, SQL Seconday : Databricks, Pyspark / Scala, CICD, Data Security, encryption Responsibilities: •Work closely with scrum master, technical leads and provide daily progress updates on the tasks assigned. •Provide support in defining the scope and sizing of the work. •Working closely with...

  • Big Data Engineer

    1 month ago


    bangalore, India Global Pharma Tek Full time

    Auto req ID BR Title Big Data Engineer Your Role and Responsibilities Understand a data warehousing solution and able to work independently in such an environment Responsible in Project development and delivery experience of a few good size projects Posting Country India State / Province Haryāna City / Township / Village Gurgaon ...

  • Big Data Engineer

    1 month ago


    bangalore, India Thomson Reuters Full time

    Big Data EngineerThe ideal candidate should be able to demonstrate strong technical aptitude and interest in learning new technologies.In this role you will work closely with our Big Data technical lead to deliver a set of Big Data services to Thomson Reuters product teams.About the RoleIn this opportunity as, Big Data Engineer, you will:  Work closely...

  • Big Data Engineer

    1 week ago


    Bangalore/Gurgaon/Gurugram, India HR BIZ HUB Full time

    Job Title : Big Data DeveloperJob Description : Bachelor's degree in Engineering or Computer Science or equivalent OR Master's in Computer Applications or equivalent. Solid Experience of software development experience and leading teams of engineers and scrum teams. 4+ years of handson experience of working with Map-Reduce, Hive, Spark (core, SQL and...

  • Big Data Architect

    2 weeks ago


    Bengaluru, Karnataka, India Unison Consulting Full time

    **Responsibilities**: Design and architect Big Data solutions to meet business requirements. Collaborate with stakeholders to understand their data and analytics needs. Create and maintain data models, data flow diagrams, and data integration strategies. Develop and implement data ingestion, processing, and storage solutions using Big Data...