Data Engineering Specialist

21 hours ago

Hyderabad Secunderabad Telangana, India beBeeDataEngineering Full time
Job Title: Data Engineering Specialist

We are seeking a highly skilled Data Engineering Specialist to design, build and maintain data lake solutions for scientific data. This vital role will drive business decisions for Research by developing scalable and high-performance data engineering solutions for large scientific datasets.

You will collaborate with Research customers to understand data requirements and design solutions that meet business needs. Additionally, you will take ownership of data pipeline projects from inception to deployment, run scope, timelines, and risks.

The ideal candidate will have proficiency in SQL and Python for data engineering, test automation frameworks (pytest), and scripting tasks. They should also have hands-on experience with big data technologies and platforms, such as Databricks, Apache Spark (PySpark, SparkSQL), workflow orchestration, performance tuning on big data processing.

Responsibilities:

  • Design, develop, and implement data pipelines, ETL/ELT processes, and data integration solutions.
  • Take ownership of data pipeline projects from inception to deployment, run scope, timelines, and risks.
  • Develop and maintain data models for biopharma scientific data, data dictionaries, and other documentation to ensure data accuracy and consistency.
  • Optimize large datasets for query performance.
  • Collaborate with global multi-functional teams including research scientists to understand data requirements and design solutions that meet business needs.
  • Implement data security and privacy measures to protect sensitive data.
  • Leverage cloud platforms (AWS preferred) to build scalable and efficient data solutions.
  • Collaborate with Data Architects, Business SMEs, Software Engineers and Data Scientists to design and develop end-to-end data pipelines to meet fast-paced business needs across geographic regions.
  • Identify and resolve complex data-related challenges.

Requirements:

  • Master's degree with 4 - 6 years of experience in Computer Science, IT, Computational Chemistry, Computational Biology/Bioinformatics or related field OR Bachelor's degree with 6 - 8 years of experience in Computer Science, IT, Computational Chemistry, Computational Biology/Bioinformatics or related field OR Diploma with years of experience in Computer Science, IT, Computational Chemistry, Computational Biology/Bioinformatics or related field.
  • 3+ years of experience in designing and supporting biopharma scientific research data pipelines.
  • Proficiency in SQL and Python for data engineering, test automation frameworks (pytest), and scripting tasks.
  • Hands-on experience with big data technologies and platforms, such as Databricks, Apache Spark (PySpark, SparkSQL), workflow orchestration, performance tuning on big data processing.

This role offers a unique opportunity to work with cutting-edge technologies and contribute to the success of our organization. We are looking for a highly motivated and detail-oriented individual who is passionate about data engineering and wants to make a meaningful impact.

  • Data Engineering Specialist

    1 day ago

    Hyderabad / Secunderabad, Telangana, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Title: Data Engineering SpecialistDetailed job description - Key Responsibilities:Lead the development and implementation of efficient data engineering solutions with a strong focus on Python and SQL programming.Design and build scalable, cost-effective datasets that support business reporting and AI/ML exploration using AWS services.Collaborate with...

  • Advanced Data Engineering Specialist

    3 days ago

    Hyderabad / Secunderabad, Telangana, India beBeeDataEngineering Full time

    Job Title: Advanced Data Engineering SpecialistOverviewSeeking a seasoned data engineering professional with 5+ years of experience in designing and implementing supply chain analytics solutions.Key ResponsibilitiesDesign, develop, and deploy large-scale data pipelines to process and transform complex data sets.Collaborate with cross-functional teams to...

  • Data Integration Specialist

    21 hours ago

    Hyderabad / Secunderabad, Telangana, India beBeeDataIntegration Full time

    Job Description">As a Data Integration Specialist, you will be responsible for designing, developing, and maintaining data integration workflows and ETL (Extract, Transform, Load) processes using Informatica tools. Your goal will be to ensure that data is accurately extracted from source systems, transformed according to business requirements, and loaded...

  • Data Security Specialist

    3 days ago

    Hyderabad / Secunderabad, Telangana, India beBeeDataSecurity Full time ₹ 9,00,000 - ₹ 12,00,000

    Job Title: Data Security Specialist We are seeking a highly skilled and experienced Data Security Specialist to join our team. As a key member of our organization, you will be responsible for ensuring the security and integrity of our data by monitoring PKWARE & Cyera data scanning and classification jobs for errors and failures.You will provide first-line...

  • Data Engineering Specialist

    3 days ago

    Hyderabad / Secunderabad, Telangana, India beBeeDataEngineering Full time

    Job Description:A Data Engineer with our team will work on designing and implementing end-to-end data pipelines, ensuring seamless data flow, automation, and reliable scheduling.Responsibilities:Collaborate with cross-functional teams to understand data requirements and translate them into efficient and scalable data solutions.Design and develop data...

  • Senior Data Engineer Role

    21 hours ago

    Hyderabad / Secunderabad, Telangana, India beBeeDataEngineering Full time

    As a Data Engineering Specialist, you will play a pivotal role in shaping our data engineering strategies.Must-Have Skills:Hands-on experience with cutting-edge technologies like Databricks, PySpark, SparkSQL, Apache Spark, AWS, Python, SQL, and Scaled Agile methodologies.Expertise in workflow orchestration, performance tuning on big data processing.Deep...

  • Data Engineering Specialist

    4 hours ago

    Hyderabad / Secunderabad, Telangana, India beBeeAzure Full time ₹ 15,00,000 - ₹ 20,00,000

    Job OpportunityWe are seeking a skilled professional to join our team as an Azure Data Engineer.Greetings from our organization. We have multiple opportunities available for this role, offering a chance to work on exciting projects and expand your expertise.The ideal candidate will possess 5+ years of experience in data engineering with a focus on Azure...

  • Cloud Data Engineering Specialist

    3 days ago

    Hyderabad / Secunderabad, Telangana, Pune, Chennai, India beBeeDataExpert Full time

    Cloud Data Engineering ExpertLead the end-to-end implementation of a cloud-based data platform.Craft and document robust data models, pipelines, and transformations within a unified data environment.Collaborate with cross-functional teams to ensure seamless integration of diverse data sources.Serve as a technical specialist for cloud-based data components,...

  • Data Quality Engineer

    8 hours ago

    Hyderabad / Secunderabad, Telangana, India beBeeData Full time ₹ 9,00,000 - ₹ 12,00,000

    Quality Assurance SpecialistWe are seeking a highly skilled Quality Assurance Specialist to join our team.Key Responsibilities:- Develop and execute automated tests using Selenium & Java and Rest Assured for API testing.- Collaborate with cross-functional teams to identify and prioritize testing needs in Data Platform, MDM, Data pipelines, ETL data...

  • Data Engineer

    8 hours ago

    Hyderabad / Secunderabad, Telangana, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Title: Data EngineerRole Summary:Our team is seeking an experienced data engineer to join our growing organization.Key Responsibilities:Design, develop, and maintain large-scale data processing systems using Azure Data Factory and Databricks.Work closely with onsite teams to deliver high-quality results and take ownership of projects.Collaborate with...