Big Data Architectural Specialist

8 hours ago

Bharatpur, Rajasthan, India beBeeData Full time ₹ 10,00,000 - ₹ 15,00,000
Job Title:

Senior Data Engineer

About the Role:

As a senior data engineer, you will play a key role in designing and implementing large-scale data systems that drive business growth. We are looking for an expert with hands-on experience in Databricks, SQL, and Python to join our dynamic team.

Responsibilities:
  • Design and implement data pipelines using Databricks SQL and Python.
  • Refactor ingestion pipelines for improved performance and scalability.
  • Develop data validation scripts for side-by-side comparisons of Teradata and Databricks environments.
  • Configure orchestration and job scheduling within the Databricks environment.
  • Perform unit, integration, UAT, and performance testing for migrated code.
  • Validate data consistency between Teradata and Databricks environments.
  • Execute jobs in UAT/QA, analyze data discrepancies, and provide timely resolutions.
Required Skills:
  • Strong expertise in Teradata ETL development & migration.
  • Proficiency in Azure Databricks, SQL, and Python programming languages.
  • Deep understanding of orchestration, scheduling, and data validation techniques.
  • Hands-on knowledge of Unity Catalog for permissions and governance.
  • Solid experience in data testing: unit, integration, UAT, and performance.
  • Strong troubleshooting, debugging, and optimization skills.
  • Familiarity with cloud environments (Azure/AWS/GCP).
What You Will Bring:
  • Migrating large-scale Teradata workloads to Databricks.
  • Implementing data validation frameworks and resolving data drift.
  • Executing side-by-side data comparisons between legacy and modern systems.
  • Applying performance tuning techniques for query and job optimization.
  • Collaborating with cross-functional stakeholders in enterprise-scale projects.
Key Qualifications:

We are seeking a highly skilled professional with strong analytical skills and excellent communication skills.

Benefits:

This is a great opportunity to grow your career as a data engineer in a leading solution service company.

Join Our Team:

If you're passionate about working on challenging projects, collaborating with talented individuals, and driving business growth through data-driven insights, we encourage you to apply for this role.

  • Senior Big Data Specialist

    8 hours ago

    Bharatpur, Rajasthan, India beBeeDataSpecialist Full time ₹ 1,10,00,000 - ₹ 1,75,00,000

    Job Title:Senior Big Data SpecialistAbout the Role:We are seeking a highly skilled Senior Big Data Specialist to join our team. As a key member of our data engineering department, you will be responsible for designing, developing, and maintaining large-scale data processing systems using big data technologies.Key Responsibilities:* Design and develop complex...

  • Big Data Architect Position

    2 days ago

    Bharatpur, Rajasthan, India beBeeCloud Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Big Data ArchitectWe are seeking an experienced cloud expert with a strong focus on big data management.This is a full-time role offering flexibility for remote work. We require hands-on experience in Azure, proficient in big data technologies, and a strong understanding of data management principles.Key Responsibilities:Design and implement big...

  • Big Data Architect

    1 week ago

    Bharatpur, Rajasthan, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    We are seeking a highly skilled Data Engineer to lead the development of our ETL pipelines. The ideal candidate will have a strong background in designing, building, and optimizing scalable data architectures using Azure Cloud technologies.Key ResponsibilitiesDesign and develop efficient ETL pipelines for batch data ingestion and egress using Azure Data...

  • Expert Big Data Engineer Wanted

    5 days ago

    Bharatpur, Rajasthan, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 30,00,000

    Job Summary:">We seek an experienced Big Data Engineer to design, implement and maintain large-scale data clusters. Key Responsibilities:">Developing scalable big data architectures.Migrating data from legacy systems.Tuning cluster performance for optimal efficiency.Providing pre- and post-platform support for application migration.Executing Linux commands...

  • Big Data Analyst

    6 days ago

    Bharatpur, Rajasthan, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Senior Data ProfessionalDrive business growth by leveraging big data technologies and tools to design, develop, and maintain large-scale data processing systems using PySpark, Hive, Spark, HBase, and DQ tools.Key Responsibilities:Develop and implement data ingestion pipelines from disparate sources onto the Big Data platform.Collaborate with cross-functional...

  • Big Data Specialist

    5 days ago

    Bharatpur, Rajasthan, India beBeeData Full time ₹ 10,00,000 - ₹ 22,50,000

    Job Title: Data ArchitectThe company is hiring a Data Architect to design and optimize scalable data pipelines and architectures.Work with cloud-based services like Azure Cloud.Design and implement effective data warehousing concepts.Develop client-ready dashboards using BI tools like Power BI, Superset or similar.As a Data Architect, you will work closely...

  • Senior Big Data Architect

    8 hours ago

    Bharatpur, Rajasthan, India beBeeDataScientist Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job OverviewWe are seeking a highly skilled and experienced Data Architect to design and implement scalable data architectures. As a key member of our team, you will play a critical role in driving business growth through innovative data solutions.Key ResponsibilitiesAnalyzing complex technical specifications to understand requirementsCoding using Spark and...

  • Highly Skilled Data Architecture Specialist Wanted

    7 days ago

    Bharatpur, Rajasthan, India beBeeDataArchitecture Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    We are seeking a highly skilled Data Architecture Specialist to join our team. The ideal candidate will have experience in designing, building, and maintaining large-scale data architectures.The successful candidate will be responsible for:Building scalable real-time and batch processing workflows using Azure Databricks, PySpark, and Apache Spark.Designing...

  • Data System Architect

    6 days ago

    Bharatpur, Rajasthan, India beBeeData Full time ₹ 15,00,000 - ₹ 22,00,000

    Big Data SpecialistWe are looking for an experienced data professional with a strong background in big data technologies to lead the development of our data pipelines and systems.Key Responsibilities:Design, develop, and optimize large-scale data pipelines and distributed data processing systems.Work extensively with Scala, Spark (PySpark), and Python for...

  • Big Data Expert

    2 days ago

    Bharatpur, Rajasthan, India beBeeDataScientist Full time ₹ 18,00,000 - ₹ 25,00,000

    Key Data Scientist RoleWe are seeking a highly skilled Data Scientist to lead our data-driven initiatives.The ideal candidate will have hands-on experience with Big Data Eco System Tools, including Scala and Hadoop. Strong SQL skills and the ability to develop, tweak queries, and work on performance enhancement are also essential.A solid understanding of...