Mastering Big Data Transformation

2 weeks ago

Belgaum, Karnataka, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

Job Title: Senior Data Engineer

We are seeking a talented and experienced professional to join our dynamic team as a Teradata Migration Specialist. The ideal candidate will have strong Databricks and SQL/Python expertise, with a deep understanding of orchestration, scheduling, and data validation techniques.

About the Role
  • Convert Teradata ETL workloads into Databricks SQL.
  • Refactor ingestion pipelines using SQL and/or Python.
  • Design and implement data validation scripts for side-by-side comparisons.
  • Configure orchestration and job scheduling within the Databricks environment.
  • Perform unit, integration, UAT, and performance testing for migrated code.
  • Validate data consistency between Teradata and Databricks environments.
  • Execute jobs in UAT/QA, analyze data discrepancies, and provide timely resolutions.
  • Deploy workloads in Unity Catalog enabled workspaces and ensure governance best practices.
  • Implement job monitoring using Databricks-native tools (system tables, workflows).
Required Skills and Qualifications
  • Strong expertise in Teradata ETL development & migration.
  • Proficiency in Azure Databricks, SQL, and Python.
  • Deep understanding of orchestration, scheduling, and data validation techniques.
  • Hands-on knowledge of Unity Catalog for permissions and governance.
  • Solid experience in data testing: unit, integration, UAT, and performance.
  • Strong troubleshooting, debugging, and optimization skills.
  • Familiarity with cloud environments (Azure/AWS/GCP).

The ideal candidate will have a strong background in SQL, Python, orchestration frameworks, and performance optimization within Databricks. This role requires in-depth technical expertise, the ability to troubleshoot complex migration challenges, and experience collaborating with multiple stakeholders in enterprise environments.

  • Big Data Developer Position

    2 weeks ago

    Belgaum, Karnataka, India beBeeDataSpecialist Full time ₹ 80,00,000 - ₹ 2,00,00,000

    Big Data Specialist Job DescriptionGreetings from our organization.We are currently seeking experienced professionals for Bigdata Scala Spark positions. The ideal candidate will have 6–12 years of experience in Bigdata and related technologies.The following skills and qualifications are required:More than 5.8 years of experience in Big Data...

  • Senior Big Data Solutions Architect

    2 weeks ago

    Belgaum, Karnataka, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Data Engineer", "Job Description", "Our company seeks a skilled data engineer to design, develop and deploy scalable data pipelines using Scala and Apache Spark (Databricks).", "", "To be successful in this role, you should have a strong background in data engineering, experience with scalable data pipelines, and proficiency in programming...

  • Mastering Big Data

    2 weeks ago

    Belgaum, Karnataka, India beBeeData Full time ₹ 1,00,00,000 - ₹ 2,00,00,000

    Job Title: Data EngineerWe are seeking an experienced Data Engineer to join our team and contribute to the development of a robust data infrastructure that supports insights and analytics for slot games.Develop and maintain scalable data pipelines to ensure high-quality, reliable data for player behavior analysis, game performance, and optimization.Ensure...

  • Big Data Specialist

    2 weeks ago

    Belgaum, Karnataka, India beBeeDataScientist Full time ₹ 15,00,000 - ₹ 25,00,000

    About us:Our company provides high-quality, cost-effective solutions to businesses. We utilize best-of-breed technologies and flexible engagement models to meet the IT requirements of companies.Job Responsibilities:Design, develop and implement big data solutions using Spark, SQL, Hive, Scala.Requirements:5-12 years of experience in big data development with...

  • Big Data Specialist

    2 weeks ago

    Belgaum, Karnataka, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Senior Data DeveloperThe role of Senior Data Developer is pivotal in crafting, implementing and managing extensive distributed data systems. Your expertise in big data technologies and relational databases will play a crucial part in driving business growth.Key Responsibilities:Designing and executing scalable data solutions to meet business needsMonitoring...

  • Big Data Engineer Opportunity

    1 week ago

    Belgaum, Karnataka, India beBeeDataEngineer Full time ₹ 12,00,000 - ₹ 17,50,000

    Job DescriptionA big data engineer is needed to design, build and maintain high-performance data pipelines. The ideal candidate will have experience with big data technologies, such as Spark and Hadoop, and be able to optimize database performance.The role involves working on scalable batch processing systems using Python and big data technologies,...

  • Big Data Solutions Specialist

    2 weeks ago

    Belgaum, Karnataka, India beBeeBigDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    We are seeking a skilled Data Engineer to fill a key position in our organization. The ideal candidate will have experience in programming languages such as Java and Scala, with expertise in Maven, Apache Spark Frameworks, and Unix Shell scripting.Main Responsibilities:Design and implement scalable data processing pipelines using tools like Apache Beam,...

  • Senior Big Data Engineer

    2 weeks ago

    Belgaum, Karnataka, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Big Data Developer Position OverviewAs a seasoned Big Data Developer, you will be part of a fast-paced team that thrives in technical environments.This role is ideal for an engineer who not only excels in hands-on project support but also has a passion for coaching and developing junior talent.You will work on live client projects, provide technical...

  • Big Data Solution Architect

    2 weeks ago

    Belgaum, Karnataka, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Big Data Solution ArchitectAbout the Role:We are looking for a skilled professional to design and implement data solutions.The ideal candidate will have 9+ years of experience in data engineering and be proficient in programming languages such as Python and Java.Key Responsibilities:Maintain architecture principles, guidelines and standards for...

  • Chief Data Solutions Architect

    2 weeks ago

    Belgaum, Karnataka, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,25,00,000

    Job Role OverviewYou will be part of a team working on analytical solutions for global distribution/sales people.The ideal candidate will have strong analytical skills and a passion for data and analytics.Responsibilities include solving challenging problems, mastering state-of-the-art technologies, building responsive applications, applying best development...