Big Data Engineer

3 weeks ago

RajasthanKarnatakaMetrosJaipurUdaipurBangaloreRaipur, IN ATech Full time

Hiring For Big Data Engineer (Spark, Scala, AWS)

Job description :

- Spark, SCALA, AWS OR Spark, python with AWS lambda exposure.

- Design, build, optimize and support new and existing data models and ETL processes based on our clients business requirements.

- Build, deploy and manage data infrastructure that can adequately handle the needs of a rapidly growing data driven organization.

- Coordinate data access and security to enable data scientists and analysts to easily access to data whenever they need too.

- Solid hands-on and Solution Architecting experience in Big-Data Technologies (AWS)

- Hands on experience in: AWS Dynamo DB, EKS, Kafka, Kinesis, Glue, EMR

- Hands-on experience of programming language like Scala with Spark.

- Good command and working experience on Hadoop Map Reduce, HDFS, Hive, HBase, and/or No-SQL Databases

- Hands on working experience on any of the data engineering analytics platform (Hortonworks Cloudera MapR AWS), AWS preferred

- Hands-on experience on Data Ingestion Apache Nifi, Apache Airflow, Sqoop, and Oozie

- Hands on working experience of data processing at scale with event driven systems, message queues (Kafka FlinkSpark Streaming)

- Hands on working Experience with AWS Services like EMR, Kinesis, S3, CloudFormation, Glue, API Gateway, Lake Foundation

Technical skills requirements :

- Hands on working Experience with AWS Athena

- Data Warehouse exposure on Apache Nifi, Apache Airflow, Kylo

- Operationalization of ML models on AWS (e.g. deployment, scheduling, model monitoring etc.)

- Feature Engineering Data Processing to be used for Model development

- Experience gathering and processing raw data at scale (including writing scripts, web scraping, calling APIs, write SQL queries, etc.)

- Experience building data pipelines for structured unstructured, real-time batch, events synchronous asynchronous using MQ, Kafka, Steam processing

- Hands-on working experience in analysing source system data and data flows, working with structured and unstructured data


- Must be very strong in writing SQL queries

- Strengthen the Data engineering team with Big Data solutions

- Strong technical, analytical, and problem-solving skills

- Strong organizational skills, with the ability to work autonomously as well as in a team-based environment - Pleasant Personality, Strong Communication & Interpersonal Skills.

(ref:hirist.tech)

  • Big Data Engineer

    2 months ago

    Rajasthan/Karnataka/Metros/Jaipur/Udaipur/Bangalore/Raipur, IN ATech Full time

    Hiring For Big Data Engineer (Spark, Scala, AWS)Job description :- Spark, SCALA, AWS OR Spark, python with AWS lambda exposure.- Design, build, optimize and support new and existing data models and ETL processes based on our clients business requirements.- Build, deploy and manage data infrastructure that can adequately handle the needs of a rapidly growing...

  • Big Data Engineer

    6 days ago

    Mumbai/Bangalore/Pune, IN Techno Wise Full time

    Job Role : Big Data EngineerRelevant Experience : 3+ yearsLocation : Navi Mumbai /Bengaluru/PuneNotice Period : Immediate or serving Notice PeriodPrimary Skills : Big Data, PySpark, Cloud- Azure or AWS, Databricks, SQL, PythonOverview : We are seeking a talented Big Data Engineer proficient in PySpark to join our dynamic team. The ideal candidate will play a...

  • Big Data/Databricks Engineer

    2 weeks ago

    Metros/Anywhere in India/Multiple Locations, IN WEN Full time

    Role : Big Data + DatabricksResponsibilities :- Design, develop, and implement scalable Big Data solutions using the Hadoop ecosystem.- Work closely with data scientists and analysts to understand their requirements and translate them into technical solutions.- Develop and optimize Spark and Hive scripts to process, transform, and analyze large datasets.-...

  • Big Data Engineer

    6 days ago

    Mumbai/Pune/Bangalore, IN Techno Wise Full time

    Job Description : We are seeking a talented Big Data Engineer proficient in PySpark to join our dynamic team. The ideal candidate will play a pivotal role in designing, implementing, and maintaining scalable data solutions leveraging the Big Data technologies like PySpark. This role requires a strong understanding of big data technologies, data engineering...

  • Senior Big Data Engineer

    3 weeks ago

    Bangalore/Pune, IN Recrud Full time

    Senior Big Data Engineer Position. Experience Required: 6 -10 Years. Employment Type: Full-Time. About Our Client:. Our client is a distinguished product engineering consulting firm based in Bangalore, dedicated to providing innovative offshore development solutions. With over half a century of combined expertise in product engineering and consulting...

  • Senior Big Data Engineer

    2 months ago

    Bangalore/Pune, IN Recrud Full time

    Senior Big Data Engineer Position. Experience Required: 6 -10 Years. Employment Type: Full-Time. About Our Client:. Our client is a distinguished product engineering consulting firm based in Bangalore, dedicated to providing innovative offshore development solutions. With over half a century of combined expertise in product engineering and consulting...

  • Publicis Sapient

    3 weeks ago

    Bangalore/Gurgaon/Gurugram, IN Publicis Sapient Full time

    Job Description :As Manager, Data Engineering, you will be responsible for translating client requirements into design, architecting, and implementing Azure Cloud based big data solutions for clients. Your role will be focused on delivering high quality solutions by independently driving design discussions related to Data Ingestion, Transformation &...

  • Big Data Quality Assurance Engineer

    2 months ago

    Bangalore/Anywhere in India/Multiple Locations, IN Leadway Resource Full time

    We are seeking a highly skilled and experienced Big Data QA Engineer to join our team. You will play a critical role in ensuring the quality of our big data platform and data solutions. You will leverage your expertise in Big Data testing methodologies, automation frameworks, and scripting languages to design, develop, and execute comprehensive test...

  • Big Data Quality Assurance Engineer

    3 weeks ago

    Bangalore/Anywhere in India/Multiple Locations, IN Leadway Resource Full time

    We are seeking a highly skilled and experienced Big Data QA Engineer to join our team. You will play a critical role in ensuring the quality of our big data platform and data solutions. You will leverage your expertise in Big Data testing methodologies, automation frameworks, and scripting languages to design, develop, and execute comprehensive test...

  • ETL Developer

    2 months ago

    Jaipur/Udaipur/Rajasthan/Karnataka/Bangalore/Mysore, IN ATech Full time

    Job : ETL DeveloperSkills Required :- Experience in the database, data integration, and data migration- Good experience (3+ years) in development using databases such as Oracle, MS SQL Server, Teradata, etc.- Minimum of 2+ years of hands-on experience with Amazon Redshift.- Strong knowledge of the AWS environment and service knowledge with S3 storage...

  • ETL Developer

    3 weeks ago

    Jaipur/Udaipur/Rajasthan/Karnataka/Bangalore/Mysore, IN ATech Full time

    Job : ETL DeveloperSkills Required :- Experience in the database, data integration, and data migration- Good experience (3+ years) in development using databases such as Oracle, MS SQL Server, Teradata, etc.- Minimum of 2+ years of hands-on experience with Amazon Redshift.- Strong knowledge of the AWS environment and service knowledge with S3 storage...

  • Hadoop Administrator

    2 months ago

    Metros/Anywhere in India/Multiple Locations, IN Dotflick Solutions Full time

    Designation : Hadoop AdministratorOpen for Pan India(Any Location)Job Description :- Development and deployment of data applications- Design Implementation of infrastructure tooling and work on horizontal frameworks and libraries- Creation of data ingestion pipelines between legacy data warehouses and the big data stack- Automation of application back-end...

  • Big Data Developer

    2 months ago

    Gurgaon/Gurugram/Bangalore, IN Workassist.in Full time

    Our hiring partner is looking for :- This is a full-time on-site role for a Big Data Developer at Big Four Consulting Firm Gurugram.- The Big Data Developer will be responsible for tasks related to Data Engineering, Extract Transform Load (ETL), Big Data, Data Warehousing, and Software Data Engineering, Big Data, Extract Transform Load (ETL), and Data...

  • Big Data Engineer

    3 weeks ago

    Any Location/Bangalore, IN Careerfit.ai Full time

    Responsibilities :Solution Design :- Design, develop, and maintain scalable big data solutions and data pipelines for efficient data ingestion, processing, storage, and analysis.- Collaborate with data scientists, analysts, and business stakeholders to identify data requirements, use cases, and business objectives.- Translate business needs into technical...

  • Big Data Engineer

    2 months ago

    Any Location/Bangalore, IN Careerfit.ai Full time

    Responsibilities :Solution Design :- Design, develop, and maintain scalable big data solutions and data pipelines for efficient data ingestion, processing, storage, and analysis.- Collaborate with data scientists, analysts, and business stakeholders to identify data requirements, use cases, and business objectives.- Translate business needs into technical...

  • Big Data Solutions Engineer

    3 weeks ago

    Bangalore/Any Location, IN Gethyr Full time

    Our company is seeking a talented Big Data Solutions Engineer to join our team.- The ideal candidate will be responsible for designing, developing, and implementing our proprietary Bigdata-powered Fin Crime solution for our clients.- The candidate will work closely with the software development team, data scientists, and product managers to understand...

  • Big Data Solutions Engineer

    3 weeks ago

    Bangalore/Any Location, IN Gethyr Full time

    Our company is seeking a talented Big Data Solutions Engineer to join our team.- The ideal candidate will be responsible for designing, developing, and implementing our proprietary Bigdata-powered Fin Crime solution for our clients.- The candidate will work closely with the software development team, data scientists, and product managers to understand...

  • Big Data Architect

    2 months ago

    Metros/Anywhere in India/Multiple Locations, IN Xcel Hire Management Solutions Full time

    Job description : - The decision-making power for data analysis and he/she should also possess the quality of architecting the massive data- Should have skills in big data tools and technologies; it includes technologies like the Hadoop, accumulo, MapReduce, Hive, HBase, panoply and redshift- Overall 10 years of experience as Principal Consultant, Subject...

  • Big Data Architect

    3 weeks ago

    Metros/Anywhere in India/Multiple Locations, IN Xcel Hire Management Solutions Full time

    Job description : - The decision-making power for data analysis and he/she should also possess the quality of architecting the massive data- Should have skills in big data tools and technologies; it includes technologies like the Hadoop, accumulo, MapReduce, Hive, HBase, panoply and redshift- Overall 10 years of experience as Principal Consultant, Subject...

  • Big Data Engineer

    2 months ago

    Bangalore/Chennai/Pune, IN ADVANSOFT Full time

    We are hiring for Data engineer with top most MNC client;Exp : 5+yearsNp : immediate to 15daysLocation : & Responsibilities : - 5+ years of working experience in ETL scalable data pipeline usin61Scala, Python, Pyspark, Hadoop, Apache Spark, Spark SQL, Kafka, Nill, and incremental Data Load with Big data technologies.- Experience working with Databases like...