Master Data Infrastructure Professional

6 days ago

Hyderabad Secunderabad Telangana, India beBeeDataEngineering Full time US$ 1,50,000 - US$ 2,00,000
Job Title

Data Infrastructure Specialist

The primary responsibility of this role is to oversee the design, development, and management of data infrastructure and pipelines within an organization. This involves a combination of technical leadership, project management, and collaboration with other teams to ensure efficient collection, storage, processing, and analysis of large datasets.

This position requires the ability to lead the design, development, and maintenance of data pipelines and ETL processes, as well as architect and implement scalable data solutions using Databricks and AWS. Additionally, the ideal candidate will be able to optimize data storage and retrieval systems using Rockset, Clickhouse, and CrateDB.

Responsibilities:

Lead the design, development, and maintenance of data pipelines and ETL processes

Architect and implement scalable data solutions using Databricks and AWS

Optimize data storage and retrieval systems using Rockset, Clickhouse, and CrateDB

Develop and maintain data APIs using FastAPI

Orchestrate and automate data workflows using Airflow

Collaborate with data scientists and analysts to support their data needs

Ensure data quality, security, and compliance across all data systems

Mentor junior data engineers and promote best practices in data engineering

Evaluate and implement new data technologies to improve the data infrastructure

Participate in cross-functional projects and provide technical leadership

Manage and optimize data storage solutions using AWS S3, implementing best practices for data lakes and data warehouses

Implement and manage Databricks Unity Catalog for centralized data governance and access control across the organization

Qualifications Required

Must-Have Qualifications:

Bachelor's or Master's degree in Computer Science, Engineering, or related field

10+ years of experience in data engineering, with at least 6 years in a lead role

Strong proficiency in Python, PySpark, and SQL

Extensive experience with Databricks and AWS cloud services

Hands-on experience with Airflow for workflow orchestration

Familiarity with FastAPI for building high-performance APIs

Experience with columnar databases like Rockset, Clickhouse, and CrateDB

Solid understanding of data modeling, data warehousing, and ETL processes

Experience with version control systems (e.g., Git) and CI/CD pipelines

Excellent problem-solving skills and ability to work in a fast-paced environment

Strong communication skills and ability to work effectively in cross-functional teams

Knowledge of data governance, security, and compliance best practices

Proficiency in designing and implementing data lake architectures using AWS S3

Experience with Databricks Unity Catalog or similar data governance and metadata management tools

Preferred Qualifications

Nice-to-Have Qualifications:

Experience with real-time data processing and streaming technologies

Familiarity with machine learning workflows and MLOps

Certifications in Databricks, AWS

Experience implementing data mesh or data fabric architectures

Knowledge of data lineage and metadata management best practices

Why You'll Love Working with Us:

Opportunity to work on business challenges from top global clientele with high impact. Vast opportunities for self-development, including online university access and sponsored certifications. Generous benefits package including health insurance, retirement benefits, flexible work hours, and more. Supportive work environment with forums to explore passions beyond work.

  • Master Data Specialist

    1 week ago

    Hyderabad / Secunderabad, Telangana, India beBeeDataOperator Full time ₹ 15,00,000 - ₹ 28,00,000

    Job DescriptionThe primary objective of this position is to contribute to the success of our organization by maintaining high-quality vendor master data in OPELLA. This role involves ensuring that all master data maintenance processes are executed efficiently and effectively, resulting in accurate and reliable data.The responsibilities of this role...

  • Senior Master Data Management Architect

    7 days ago

    Hyderabad / Secunderabad, Telangana, India beBeeDataManagement Full time ₹ 1,04,000 - ₹ 1,30,878

    We are seeking a seasoned professional to lead the strategic development and operations of our Master Data Management (MDM) platforms. This is a technical, hands-on role that requires a strong background in both Data Engineering and MDM.Key ResponsibilitiesStrategic Leadership: Lead a team of data professionals, providing technical leadership and mentorship....

  • Master Data Specialist

    2 weeks ago

    Hyderabad / Secunderabad, Telangana, India beBeeDataAnalyst Full time ₹ 8,00,000 - ₹ 12,00,000

    Job Description">">The primary objective of the Data Analyst role is to ensure the integrity and quality of site master data by analyzing the basic requirements, maintaining attributes in systems, and verifying that all included data are reliable and sourced from the right places.">This position requires a strong understanding of Supply Chain Management,...

  • Master Data Architect

    7 days ago

    Hyderabad / Secunderabad, Telangana, India beBeeData Full time ₹ 1,04,000 - ₹ 1,30,878

    Job DescriptionAs a visionary Architect, you will spearhead the design, development, and deployment of advanced data integration solutions for Global Medical teams. Your expertise will enable actionable insights across diverse business capabilities.You will design integrated solutions and analytical summarized dimensional data models and datasets to augment...

  • Master Data Management Specialist

    2 weeks ago

    Hyderabad / Secunderabad, Telangana, India beBeeDataManagement Full time ₹ 1,50,000 - ₹ 28,00,000

    Job DescriptionAs a Master Data Management Specialist, you will be responsible for setting up and performing complex local and global master data setup, establishing processes, guidelines, business matrices, and SLA timelines in a GxP environment while adhering to Novartis compliance.Set up and maintain accurate and complete master data records.Develop and...

  • Master Data Management Professional

    2 weeks ago

    Hyderabad / Secunderabad, Telangana, Pune, Chennai, India beBeeInformatica Full time US$ 60,000 - US$ 1,20,000

    Job opportunity in Master Data ManagementHiring for experienced professionals with 3 years or more of Informatica MDM backgroundKey skills required include Informatica MDM, Master data Management Informatica, and Informatica DeveloperEducational qualifications: Bachelor's degree in Engineering, Computer Applications, or related fieldsResponsibilities and...

  • Master Data Solutions Specialist

    7 days ago

    Hyderabad / Secunderabad, Telangana, India beBeeBusiness Full time ₹ 15,00,000 - ₹ 28,00,000

    Job Title: Business Data Consultant">Description: Key Roles and Responsibilities:  Collaborate with stakeholders to understand business requirements.  Participate in discussions on data quality implementation and architecture.  Engage with O2C, Tax, Trading Partner Finance, Logistics teams to gather business rules.  Develop business requirements to...

  • Senior Master Data Manager

    2 weeks ago

    Hyderabad / Secunderabad, Telangana, India beBeeDataEngineer Full time ₹ 5,00,000 - ₹ 8,00,000

    As a key member of our organization, you will be responsible for analyzing and managing customer master data using Reltio or Informatica MDM solutions.You will perform advanced SQL queries and data analysis to validate and ensure master data integrity.Leverage Python, PySpark , and Databricks for scalable data processing and automation.Collaborate with...

  • Master Data Management Specialist

    7 days ago

    Hyderabad / Secunderabad, Telangana, India beBeeDataManagement Full time ₹ 1,50,000 - ₹ 28,00,000

    Master Data Management SpecialistWe are seeking a highly skilled Master Data Management Specialist to join our team. As a key contributor, you will be responsible for maintaining the accuracy and consistency of master data across the organization.ResponsibilitiesData Operations: Perform daily data operations tasks, including maintenance and validation, to...

  • Senior Master Data Governance Lead

    7 days ago

    Hyderabad / Secunderabad, Telangana, India beBeeGovernance Full time ₹ 15,00,000 - ₹ 28,00,000

    Job Description:As a Senior Master Data Governance Lead, you will oversee the accuracy, consistency, and governance of critical customer data across the organization. This role requires a leader who can manage a team, drive process improvements, and collaborate with cross-functional teams to resolve complex data issues.Key Responsibilities:Leadership &...