Big Data Engineer

2 weeks ago

Greater Noida Hyderabad, India Coforge Full time ₹ 15,00,000 - ₹ 20,00,000 per year

Job Location:- Hyderabad & Noida

Experience Required: 5 to 8 Years

Mandatory Skills (Hands on experience required)- Spark, Scala, Big Data (Hadoop), AWS, SQL

Shift- UK Shift

Streaming data Technical skills requirements :-

Experience- 5+ Years Solid hands-on and Solution Architecting experience in Big-Data Technologies (AWS preferred)

- Hands on experience in: AWS Dynamo DB, EKS, Kafka, Kinesis, Glue, EMR- Hands-on experience of programming language like Scala with Spark.- Good command and working experience on Hadoop Map Reduce, HDFS, Hive, HBase, and/or No-SQL Databases - Hands on working experience on any of the data engineering analytics platform (Hortonworks Cloudera MapR AWS), AWS preferred- Hands-on experience on Data Ingestion Apache Nifi, Apache Airflow, Sqoop, and Oozie - Hands on working experience of data processing at scale with event driven systems, message queues (Kafka Flink Spark Streaming)

Hands-on development experience on above technologies

  • Data Warehouse exposure on Apache Nifi, Apache Airflow, Kylo - Operationalization of ML models on AWS (e.g. deployment, scheduling, model monitoring etc.)

  • Feature Engineering Data Processing to be used for Model development- Experience gathering and processing raw data at scale (including writing scripts, web scraping, calling APIs, write SQL queries, etc.)

  • Experience building data pipelines for structured unstructured, real-time batch, events synchronous asynchronous using MQ, Kafka, Steam processing

  • Hands-on working experience in analysing source system data and data flows, working with structured and unstructured data

  • Must be very strong in writing SQL queries.

  • Big Data Engineer

    2 weeks ago

    Greater Noida, Hyderabad, Pune, India Coforge Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Coforge Ltd is Hiring for Big Data Engineer AWS & Spark (Scala).Are you passionate about building scalable data solutions using cutting-edge technologies? Join Coforge Ltd as a Big Data Engineer and be part of a dynamic team driving innovation in cloud-based data engineering.Company: Coforge Ltd.Experience Required: 4 to 6 YearsJob Locations: Pune,...

  • Big Data engineer

    2 weeks ago

    Hyderabad, Telangana, India Cozzera Full time

    Job Title: Data Engineer Location: Hyderabad | Type: Full-time Description: We're hiring a Big Data Engineer to design and implement scalable data pipelines and streaming applications. You'll work with modern big data technologies and cloud platforms to power real-time data solutions. Key Skills: Strong software engineering with Java,...

  • Big Data engineer

    2 weeks ago

    Hyderabad, Telangana, India Cozzera Full time US$ 90,000 - US$ 1,20,000 per year

    Job Title:Data Engineer Location:Hyderabad | Type:Full-time Description:We're hiring aBig Data Engineerto design and implement scalable data pipelines and streaming applications. You'll work with modern big data technologies and cloud platforms to power real-time data solutions. Key Skills:Strong software engineering with Java, Scala, or PythonExpertise in...

  • Senior Big Data Engineer

    1 week ago

    Hyderabad, Telangana, India Veltris Full time

    Position-Senior Big Data EngineerMust have Big Data analytics platform experience.• Key stacks: Spark, Druid, Drill, ClickHouse.• 8 years experience in Python/Java, CI/CD, infrastructure & cloud, Terraform, plus depth in:           o Big Data pipelines: Spark, Kafka, Glue, EMR, Hudi, Schema Registry, Data Lineage.           o Graph...

  • Big Data Engineer

    2 weeks ago

    Noida, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 10,00,000 - ₹ 25,00,000

    Big Data EngineeringAt the forefront of big data processing lies a complex web of systems, tools and workflows. To engineer such processes requires expertise in multiple areas, including data flow platforms, workflow management and large dataset integration.Our ideal candidate will possess hands-on experience with Apache Spark, utilizing Scala for...

  • Big Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India Allegis Group Full time US$ 1,20,000 - US$ 2,00,000 per year

    Role & responsibilitiesConsult on or participate in moderately complex initiatives and deliverables within Software Engineering and contribute to large-scale planning related to Software Engineering deliverables.Review and analyze moderately complex Software Engineering challenges that require an in-depth evaluation of variable factors.Contribute to the...

  • Big Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Big Data EngineerWe are looking for a skilled Big Data Engineer to design, develop, and maintain large-scale data pipelines using PySpark and Databricks. Key Responsibilities:Design and implement scalable data architectures using PySpark and Databricks.Develop and optimize Spark applications using Spark UI and performance tuning techniques.Work with large...

  • Senior Big Data Engineer

    1 week ago

    Hyderabad, Telangana, India beBeeDataEngineer Full time ₹ 16,32,000 - ₹ 21,66,000

    Big Data Engineer RoleAs a skilled Big Data Engineer, you will be responsible for developing, constructing, testing and maintaining data acquisition pipelines for large volumes of structured and unstructured data. This role is ideal for those who enjoy working with big data and have experience in handling large datasets.Responsibilities:Develop data...

  • Big Data Engineer

    2 weeks ago

    Chennai, Hyderabad, India Orcanexgen Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    BigData EngineerHyderabad, ChennaiHybrid mode5+ years of experienceJob Description:Highly skilled Big Data Engineer with expertise in distributed systems, and advanced programming techniques. Candidate will possess experience in developing highly scalable Big Data pipelines, strong technical knowledge, thought leadership, and a passion for creating...

  • Big Data Engineering Specialist

    4 days ago

    Hyderabad, Telangana, India beBeeDataEngineering Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Job OverviewWe are seeking a seasoned data engineering professional to spearhead the development and implementation of cutting-edge big data analytics platforms.Key Responsibilities:Design and implement robust big data pipelines utilizing Spark, Kafka, Glue, EMR, Hudi, Schema Registry, and Data Lineage.Develop expertise in graph databases such as Neo4j,...