Data Engineer

2 days ago

Hyderabad, Telangana, India beBeeDataEngineer Full time US$ 11,40,000 - US$ 16,22,000

Job Title:

">

Data Engineer - Performance Optimization Specialist

">

Overview:

">

We are seeking a skilled Data Engineer to join our team and optimize our data processing capabilities. The ideal candidate will have experience in designing, building, and maintaining high-performance data pipelines.

">

Key Responsibilities:

">

  1. ">
  2. Design and implement scalable batch processing systems using Python and big data technologies">
  3. Optimize database performance, focusing on slow-running queries and latency improvements">
  4. Use Python profilers and performance monitoring tools to identify bottlenecks">
  5. Reduce P95 and P99 latency metrics across our data platform">
  6. Build efficient ETL pipelines that can handle large-scale data processing">
  7. Collaborate with data scientists and product teams to understand data requirements">
  8. Monitor and troubleshoot data pipeline issues in production">
  9. Implement data quality checks and validation mechanisms">
  10. Document data architecture and engineering processes">
">

Requirements:

">

  1. ">
  2. Bachelor's degree in Computer Science, Engineering, or related technical field">
  3. 4+ years of experience in data engineering roles">
  4. Strong Python programming skills with focus on data processing libraries">
  5. Experience with big data technologies (Spark, Hadoop, etc.)">
  6. Proven experience optimizing database performance (SQL or NoSQL)">
  7. Knowledge of data pipeline orchestration tools (Airflow, Luigi, etc.)">
  8. Understanding of performance optimization techniques and profiling tools">
  9. Experience with cloud platforms (AWS, GCP, or Azure)">
  10. Ability to translate business requirements into technical specifications">
">

Preferred Qualifications:

">

  1. ">
  2. Master's degree in Computer Science or related field">
  3. Experience with SEO data or web crawling systems">
  4. Experience with Clickhouse Database">
  5. Knowledge of distributed systems and microservices architecture">
  6. Familiarity with container orchestration (Kubernetes, Docker)">
  7. Experience with real-time data processing">
  8. Contributions to open-source projects">
  9. Experience with machine learning operations">
">

Skills and Abilities:

">

  1. ">
  2. Strong analytical thinking and problem-solving skills">
  3. Excellent attention to detail and commitment to data quality">
  4. Ability to work effectively in a collaborative team environment">
  5. Good communication skills to explain complex technical concepts">
  6. Self-motivated with the ability to work independently">
  7. Passion for performance optimization and efficiency">
"]}},

  • Azure Data Engineer

    5 days ago

    Hyderabad, Telangana, India Enable Data Incorporated Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Enable Data Incorporated is currently seeking a skilled and experienced Azure Data Engineer to join our dynamic team. As a leading provider of advanced application, data, and cloud engineering services, Enable Data has developed deep expertise across various industries. We work closely with our customers to leverage modern solutions and technologies to drive...

  • Azure Data Engineer ll

    4 weeks ago

    Hyderabad, Telangana, India Enable Data Incorporated Full time

    Enable Data Incorporated is currently seeking a skilled and experienced Azure Data Engineer to join our dynamic team. As a leading provider of advanced application, data, and cloud engineering services, Enable Data has developed deep expertise across various industries. We work closely with our customers to leverage modern solutions and technologies to drive...

  • Digital Engineering Lead Engineer

    3 weeks ago

    Hyderabad, Telangana, India NTT DATA Full time

    Req ID 253253 NTT DATA Services strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Digital Engineering Lead Engineer to join our team in Hyderabad Telangana IN-TG India IN -Sr Syniti ADM...

  • Devops Engineer

    2 days ago

    Hyderabad, Telangana, India NTT DATA Full time

    Req ID 300721NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a DevOps Engineer - Digital Solution Consultant Sr Analyst to join our team in Hyderabad Telangana IN-TG India IN ...

  • Snowflake Engineer

    2 weeks ago

    Hyderabad, Telangana, India NTT Data Full time

    Job DescriptionNTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Snowflake Engineer - Digital Solution Consultant Sr. Analyst to join our team in Hyderabad, Telangana (IN-TG), India...

  • Salesforce Data Cloud Consultant

    2 weeks ago

    Hyderabad, Telangana, India NTT Data Full time

    Job DescriptionNTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Salesforce Data Cloud Consultant to join our team in Hyderabad, Telangana, India.Job Title: Salesforce Data Cloud...

  • Data Engineer

    4 weeks ago

    Hyderabad, Telangana, India People Tech Group Inc Full time

    Job Title: Data EngineerExperience: 5-9 YearsLocation: HyderabadJob Type: Full-TimeJob Summary:We are seeking a highly skilled Senior Data Engineer with 5+ years of experience in data engineering and migration projects. The ideal candidate will have strong expertise in SQL, Python, data modeling, and building scalable data pipelines. Proficiency with big...

  • Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India People Tech Group Inc Full time

    Job Title: Data Engineer Experience: 5-9 Years Location: Hyderabad Job Type: Full-Time Job Summary: We are seeking a highly skilled Senior Data Engineer with 5+ years of experience in data engineering and migration projects. The ideal candidate will have strong expertise in SQL, Python, data modeling, and building scalable data pipelines. Proficiency...

  • Data Engineer

    4 days ago

    Hyderabad, Telangana, India Softmaster technology solutions Full time

    Company DescriptionSoftMaster Technology Solutions provides end-to-end IT services, including custom software development, web & mobile application development, cloud solutions, data analytics & AI, and enterprise solutions. They offer training and placement programs for fresh graduates and professionals in IT careers through online, offline, and hybrid...

  • Data Engineer

    4 weeks ago

    Hyderabad, Telangana, India Latinem Private Limited Full time

    About Us:Latinem India – Global Capability Centre Latinem is a high-performance Global Capability Centre (GCC) delivering world-class strategic, digital, and operational support to Sobha's markets across the Middle East, the United States, and Australia, the leading developer in the Middle East.Driven by excellence and innovation, Latinem is more than just...