Big Data Engineer

2 days ago

Hyderabad, Telangana, India Techno-Comp Computer Services Pvt. Ltd. Full time ₹ 12,00,000 - ₹ 36,00,000 per year

JOB RESPONSIBILITY

·
Experience with Big Data technologies will be a plus (Hadoop, Spark, Kafka, HBase, etc)

·

Write SQL queries to validate the dashboard output

·

Working experience with database environment - understanding relational database structure and hands-on SQL knowledge to extract/manipulate data for variance testing.

·

Performing code reviews and pair programming

·

Supporting and enhancing current applications

·

Design, develop, test, and implement the application investigate and resolve complex issues while supporting existing applications.

QUALIFICATION

· B.Tech /B.E /MCA

EXPERIENCE

·
6+ year's experience in AWS Services: RDS, AWS Lambda, AWS Glue, Apache Spark, Kafka, Spark streaming, spark, Scala , Hive and AWS etc.

·

6+  year's experience SQL and NoSQL databases like MySQL, Postgres, Elasticsearch

·

6+  year's experience with Spark programming paradigms (batch and stream-processing)

·

6+  year's experience in Java, Scala. Familiarity with a scripting language like Python as well as Unix/Linux shells

·

6+  year's experience with Strong analytical skills and advanced SQL knowledge, indexing, query optimization techniques.

SKILLS AND COMPETENCIES

·
Profound understanding of Big Data core concepts and technologies –  Apache Spark, Kafka, Spark streaming, spark, Scala , Hive and AWS etc.

·

Solid experience and understanding of various core AWS services such as IAM, Cloud Formation, EC2, S3, EMR, Glue, Lambda, Athena, and Redshift. Data Engineer (Bigdata, Kafka, Spark streaming, spark, Scala and AWS).

·

Experience in system analysis, design, development, and implementation of data ingestion pipeline in AWS.

·

Programming experience with Python/Scala, Shell scripting.

·

Experience with DevOps and Continuous Integration/Delivery (CI/CD) concepts and tools such as Bitbucket and Bamboo.

·

Good understanding of business and operational processes.

·

Capable of Problem / issue resolution, capable of thinking out of the box.

  • Big Data Engineer

    1 week ago

    Hyderabad, Telangana, India Sheryl strategic solutions Pvt. LTD . Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Description : Position : Big Data Engineer Location : Hyderabad, India (Hybrid, 2-3 times per week on any weekdays) Duration : 1 year Job Summary : Experian FSD is seeking a skilled and motivated Big Data Engineer to join our dynamic data engineering team. This hybrid role based in Hyderabad offers the opportunity to work on cutting-edge data...

  • Big Data Engineer

    2 days ago

    Hyderabad, Telangana, India Pennant Technologies Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job Title: Senior Big Data EngineerDepartment: Data & AnalyticsEmployment Type: Full‑timeRole OverviewWe are seeking an experienced Big Data Engineer to join our growing Data & Analytics team. In this role, you'll design, build, and optimize our modern data platform—enabling scalable pipelines, reliable data lakes, and robust ML operations. You'll work...

  • Big Data Engineer

    2 days ago

    Hyderabad, Telangana, India Softility, Inc. Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Company DescriptionSoftility is a digital transformation technology services company specializing in cloud adoption, data engineering, AI-driven operations, digital service management, and cybersecurity. We are the preferred partner for many Fortune 500 companies, SLED entities, healthcare institutions, major enterprises, and federal agencies. Headquartered...

  • Big Data Engineer

    2 days ago

    Hyderabad, Telangana, India Pennant Technologies Private Limited Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job DescriptionWe are looking for experienced Big Data Engineers to join our growing Data & Analytics team. In this role, you'll design, build, and optimize our modern data platform—enabling scalable pipelines, reliable data lakes, and robust ML operations. You'll work closely with data scientists, analysts, and stakeholders to turn raw data into...

  • Big Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India Skilviu Soft Solutions Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Role: Big Data EngineerLocation: Hyderabad, India (Hybrid).Experience: 5+ YearsDuration: 1 year+Notice Period: Immediate -15 days.Key Responsibilities:Design, develop, and maintain scalable data processing pipelines using Spark/PySpark and Hadoop on AWS.Implement and optimize data workflows on AWS EMR, EC2, and ECS.Develop and integrate RESTful APIs and AWS...

  • Big Data Operations Engineer

    1 week ago

    Hyderabad, Telangana, India S M Software Solutions Inc Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job Description – Big Data Operations EngineerLocation :Onsite, Hyderabad SoftilityExperience: 5+ yearsRole OverviewWe are looking for a skilledBig Data Operations Engineerwith hands-on experience in supporting and maintaining large-scale data platforms. The role involves ensuring platform availability, managing incidents, monitoring performance through...

  • Big Data Engineer

    1 week ago

    Hyderabad, Telangana, India, Telangana Rapinno Tech Solutions Pvt.Ltd. Full time

    Big Data Engineer Locations: Hyderabad | Chennai | Pune | Bangalore Skills: Scala, Python, Apache Spark, PySpark, AWS, CI/CD Experience: 3 to 11 years Scala Developer Multiple Locations Strong hands-on experience in Scala & distributed data processing

  • Big Data Developer

    43 minutes ago

    Hyderabad, Telangana, India KPG99 INC Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    About the Role:Experian FSD is seeking a skilled and motivated Big Data Engineer to join our dynamic data engineering team. This hybrid role based in Hyderabad offers the opportunity to work on cutting-edge data platforms and services that power Experian's global data ecosystem. You will be instrumental in building scalable data pipelines, integrating APIs,...

  • Big Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India Techno Facts Solutions Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Experience in developing and delivering scalable big data pipelines using Apache Spark and Databricks on AWS.Position Requirements :Must Have : Build and maintain scalable data pipelines using Databricks and Apache Spark. Develop and optimize ETL/ELT processes for structured and unstructured data. Knowledge of Lakehouse architecture for efficient data...

  • Big Data

    6 hours ago

    Hyderabad, Telangana, India RiskInsight Consulting Pvt Ltd Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    ResponsibilitiesProvide technical support and troubleshooting for Big Data applications and systems built on the Hadoop ecosystem. Monitor system performance, analyze logs, and identify potential issues before they impact services. Collaborate with engineering teams to deploy and configure Hadoop clusters and related components. Assist in maintenance and...