Big Data Engineer

1 day ago

Hyderabad, Telangana, India Techno-Comp Computer Services Pvt. Ltd. Full time ₹ 12,00,000 - ₹ 36,00,000 per year

JOB RESPONSIBILITY

·
Experience with Big Data technologies will be a plus (Hadoop, Spark, Kafka, HBase, etc)

·

Write SQL queries to validate the dashboard output

·

Working experience with database environment - understanding relational database structure and hands-on SQL knowledge to extract/manipulate data for variance testing.

·

Performing code reviews and pair programming

·

Supporting and enhancing current applications

·

Design, develop, test, and implement the application investigate and resolve complex issues while supporting existing applications.

QUALIFICATION

· B.Tech /B.E /MCA

EXPERIENCE

·
6+ year's experience in AWS Services: RDS, AWS Lambda, AWS Glue, Apache Spark, Kafka, Spark streaming, spark, Scala , Hive and AWS etc.

·

6+  year's experience SQL and NoSQL databases like MySQL, Postgres, Elasticsearch

·

6+  year's experience with Spark programming paradigms (batch and stream-processing)

·

6+  year's experience in Java, Scala. Familiarity with a scripting language like Python as well as Unix/Linux shells

·

6+  year's experience with Strong analytical skills and advanced SQL knowledge, indexing, query optimization techniques.

SKILLS AND COMPETENCIES

·
Profound understanding of Big Data core concepts and technologies –  Apache Spark, Kafka, Spark streaming, spark, Scala , Hive and AWS etc.

·

Solid experience and understanding of various core AWS services such as IAM, Cloud Formation, EC2, S3, EMR, Glue, Lambda, Athena, and Redshift. Data Engineer (Bigdata, Kafka, Spark streaming, spark, Scala and AWS).

·

Experience in system analysis, design, development, and implementation of data ingestion pipeline in AWS.

·

Programming experience with Python/Scala, Shell scripting.

·

Experience with DevOps and Continuous Integration/Delivery (CI/CD) concepts and tools such as Bitbucket and Bamboo.

·

Good understanding of business and operational processes.

·

Capable of Problem / issue resolution, capable of thinking out of the box.

  • Big Data engineer

    3 weeks ago

    Hyderabad, Telangana, India Cozzera Full time

    Job Title: Data Engineer Location: Hyderabad | Type: Full-time Description: We're hiring a Big Data Engineer to design and implement scalable data pipelines and streaming applications. You'll work with modern big data technologies and cloud platforms to power real-time data solutions. Key Skills: Strong software engineering with Java,...

  • Senior Big Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India Veltris Full time

    Position-Senior Big Data EngineerMust have Big Data analytics platform experience.• Key stacks: Spark, Druid, Drill, ClickHouse.• 8 years experience in Python/Java, CI/CD, infrastructure & cloud, Terraform, plus depth in:           o Big Data pipelines: Spark, Kafka, Glue, EMR, Hudi, Schema Registry, Data Lineage.           o Graph...

  • Big Data Engineer

    1 day ago

    Hyderabad, Telangana, India Softility, Inc. Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Company DescriptionSoftility is a digital transformation technology services company specializing in cloud adoption, data engineering, AI-driven operations, digital service management, and cybersecurity. We are the preferred partner for many Fortune 500 companies, SLED entities, healthcare institutions, major enterprises, and federal agencies. Headquartered...

  • Big Data Engineering Specialist

    2 weeks ago

    Hyderabad, Telangana, India beBeeDataEngineering Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Job OverviewWe are seeking a seasoned data engineering professional to spearhead the development and implementation of cutting-edge big data analytics platforms.Key Responsibilities:Design and implement robust big data pipelines utilizing Spark, Kafka, Glue, EMR, Hudi, Schema Registry, and Data Lineage.Develop expertise in graph databases such as Neo4j,...

  • Big Data Engineering Leader

    2 weeks ago

    Hyderabad, Telangana, India beBeeDataEngineering Full time ₹ 30,00,000 - ₹ 36,00,000

    Job Title:Big Data Engineering LeaderWe are seeking a Big Data Engineering Leader to join our team. As a key member of our engineering organization, you will be responsible for delivering roadmap features of our Enterprise TruRisk Platform.This platform helps customers Measure, Communicate and Eliminate Cyber Risks. You will work closely with...

  • Big Data Developer

    3 weeks ago

    Hyderabad, Telangana, India Alp Consulting Ltd. Full time

    Job Title: Big Data DeveloperWork Location: Hyderabad, Telangana (TG), IndiaExperience Range: 6–8 YearsSkill Area: Digital – Big Data and Hadoop EcosystemsJob Description:We are looking for an experienced and results-driven Big Data Developer to join our dynamic team in Hyderabad. The ideal candidate will have a strong background in designing,...

  • Big Data Developer

    3 weeks ago

    Hyderabad, Telangana, India Alp Consulting Ltd. Full time

    Job Title: Big Data Developer Work Location: Hyderabad, Telangana (TG), India Experience Range: 6–8 Years Skill Area: Digital – Big Data and Hadoop Ecosystems Job Description: We are looking for an experienced and results-driven Big Data Developer to join our dynamic team in Hyderabad. The ideal candidate will have a strong background in...

  • Big Data Developer

    2 weeks ago

    Hyderabad, Telangana, India Alp Consulting Ltd. Full time

    Job Title: Big Data DeveloperWork Location: Hyderabad, Telangana (TG), India Experience Range: 6–8 Years Skill Area: Digital – Big Data and Hadoop EcosystemsJob Description:We are looking for an experienced and results-driven Big Data Developer to join our dynamic team in Hyderabad. The ideal candidate will have a strong background in designing,...

  • Big Data Developer

    2 weeks ago

    Hyderabad, Telangana, India Kresta Softech Private Limited Full time

    Role Highlights: Position: Big Data Engineer Experience: 2+ years Location: Hyderabad, Chennai- Hybrid Notice Period: Immediate/7 days joiners mandate Job Overview: Must have skills- Big Data, Scala, AWS and Python or Java

  • Big Data Engineer- Professional Services

    2 weeks ago

    Hyderabad, Telangana, India BrightEdge Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    About UsBrightEdge is a leading SEO and content performance marketing platform that transforms online content into tangible business results. Our platform processes massive amounts of data to provide actionable insights to our clients. We're looking for a talented Big Data Engineer to join our Professional Services to help us scale and optimize our data...