Principal Data Engineer

2 weeks ago

Hyderabad Secunderabad Telangana, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 28,00,000
Key Roles and Responsibilities
  • Develop and optimize data processing jobs using PySpark for complex transformations and aggregations, ensuring data integrity and scalability.
  • Design and implement robust data pipelines on AWS, adhering to best practices in data modeling and ETL, to meet business objectives.
  • Utilize AWS services like EC2 and S3 for data processing and storage solutions, leveraging their strengths to improve efficiency.
  • Manage SQL database schema design, query optimization, and performance tuning to ensure optimal database performance.
  • Design and maintain scalable data warehouses using best practices in data modeling and ETL, to support business growth.
  • Leverage modern data platforms for collaborative data science across varied sources, fostering a culture of innovation.
  • Maintain Databricks clusters and Spark jobs for optimal performance and data quality, ensuring seamless execution.
  • Implement security, backup procedures, and disaster recovery plans using AWS best practices, mitigating risks and ensuring business continuity.
  • Manage source code and automate deployment via GitHub with CI/CD pipelines, streamlining the development process.
  • Troubleshoot and optimize PySpark scripts, Databricks notebooks, SQL queries, and Airflow DAGs, resolving issues efficiently.
  • Stay current with advancements in cloud data technologies and recommend useful tools, driving technology adoption.
  • Use Apache Airflow for orchestrating and automating data workflows reliably, improving productivity.
  • Collaborate with data scientists and analysts to build models and pipelines for analytics and ML projects, fostering a collaborative environment.

  • Principal Salesforce Architect

    2 weeks ago

    Hyderabad, Telangana, India NTT DATA Full time

    We are currently seeking a Principal Salesforce Architect to join our team in Hyderabad, Telangana, India. **Minimum Qualifications**: - 5+ years IT experience in a Salesforce environment leveraging Salesforce Core capabilities Bachelor of Engineering in Computer Science or equivalent from an accredited university or college. **Preferred...

  • Principal Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India ixceed Full time ₹ 3,00,000 - ₹ 40,00,000 per year

    Role: Principal Data EngineerLocation: HyderabadMode: HybridType: ContractJob Description:We are seeking a Principal Data Engineer with strong enterprise-level data architecture and engineering experience, specifically within the logistics and manufacturing domains. This role is heavily focused on architecting and developing scalable data solutions using the...

  • Principal data engineer

    4 days ago

    Hyderabad, India Insight Global Full time

    DetailsIMMEDIATE JOINER NEEDED - within 2 weeks of accepting offer On going contract opportunity - starting as 6 months but can extend to 1-2 yearsHybrid in Hyderabad 2-3 times a week40 hours a week, working ISTPay $10-19/hr USDProvidence Fund ContributionsExcellent benefits packageREQUIRED SKILLS AND EXPERIENCE8+ years experience as a Data Engineer...

  • Principal Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India Anblicks Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Role / Job Title:Principal EngineerExperience required:10+ yearsLocation:Hyderabad / AhmedabadJob Type:Full-TimeJob OverviewAs a Principal Data Engineer at Anblicks, you will be at the forefront of driving our clients' data and analytics transformations. Your role involves designing and presenting cutting-edge data architectures, fostering client...

  • Principal Data Engineer

    2 days ago

    Hyderabad, India Anblicks Full time

    Role / Job Title:Principal Engineer Experience required:10+ years Location:Hyderabad / Ahmedabad Job Type:Full-Time Job OverviewAs a Principal Data Engineer at Anblicks, you will be at the forefront of driving our clients' data and analytics transformations. Your role involves designing and presenting cutting-edge data architectures, fostering client...

  • Principal Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India Insight Global Full time

    DetailsIMMEDIATE JOINER NEEDED - within 2 weeks of accepting offer On going contract opportunity - starting as 6 months but can extend to 1-2 yearsHybrid in Hyderabad 2-3 times a week40 hours a week, working ISTPay $10-19/hr USDProvidence Fund ContributionsExcellent benefits packageREQUIRED SKILLS AND EXPERIENCE8+ years experience as a Data Engineer...

  • Principal Engineer

    2 days ago

    Hyderabad, Telangana, India McDonalds Full time

    About McDonalds in IndiaOne of the worlds largest employers with locations in more than 100 countries McDonalds Corporation has corporate opportunities in Hyderabad Our global offices serve as dynamic innovation and operations hubs designed to expand McDonald s global talent base and in-house expertise Our new office in Hyderabad will bring together...

  • Principal Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India Insight Global Full time

    DetailsIMMEDIATE JOINER NEEDED - within 2 weeks of accepting offer On going contract opportunity - starting as 6 months but can extend to 1-2 yearsHybrid in Hyderabad 2-3 times a week40 hours a week, working ISTPay $10-19/hr USDProvidence Fund ContributionsExcellent benefits packageREQUIRED SKILLS AND EXPERIENCE8+ years experience as a Data Engineer...

  • Principal Data Engineer

    5 days ago

    Hyderabad, India Insight Global Full time

    Details IMMEDIATE JOINER NEEDED - within 2 weeks of accepting offer On going contract opportunity - starting as 6 months but can extend to 1-2 years Hybrid in Hyderabad 2-3 times a week 40 hours a week, working IST Pay $10-19/hr USD Providence Fund Contributions Excellent benefits package REQUIRED SKILLS AND EXPERIENCE 8+ years...

  • Principal Data Engineer

    5 days ago

    Hyderabad, India Insight Global Full time

    DetailsIMMEDIATE JOINER NEEDED - within 2 weeks of accepting offer On going contract opportunity - starting as 6 months but can extend to 1-2 yearsHybrid in Hyderabad 2-3 times a week40 hours a week, working ISTPay $10-19/hr USDProvidence Fund ContributionsExcellent benefits packageREQUIRED SKILLS AND EXPERIENCE8+ years experience as a Data Engineer...