Big Data Engineer

2 days ago

Rajahmundry, India K&K Talents - India Full time

K&K Talents is an international recruiting agency that has been providing technical resources globally since 1993. This position is with one of our clients in India , who is actively hiring candidates to expand their teams. Title: Big Data Engineer (Scala & Spark) Location: PAN India (Hybrid) Employment Type: Permanent Notice Period: 15 Days Required Experience: 8 Years and above Role We are seeking a highly skilled Senior Data Engineer with strong expertise in Azure cloud, Big Data technologies, and distributed data processing frameworks . The ideal candidate will design, build, optimize, and manage large-scale data pipelines that support both batch and real-time analytics. This role requires hands-on experience in Azure Databricks, ADF, Synapse, Spark (Scala/PySpark) , and modern ETL/data integration practices. Responsibilities Design and build scalable, high-performance data pipelines using Azure Databricks, ADF, and Spark. Develop and optimize Spark (Scala/PySpark) jobs for large-volume data processing and transformation. Manage and integrate data from diverse sources including ADLS, Blob Storage, SQL databases, NoSQL stores, and streaming platforms . Implement and support real-time data streaming using Kafka, Spark Streaming, or Flink. Create and maintain ETL workflows , ensuring data quality, reliability, and consistency. Work with Azure Synapse Analytics, Snowflake, or BigQuery for warehousing and analytics solutions. Build and maintain CI/CD pipelines using Azure DevOps/Jenkins for automated deployments. Collaborate with data architects, analysts, and data scientists to enable analytics, ML workflows, and business insights. Optimize query performance, storage, cost, and compute usage across pipelines and cloud environments. Ensure data governance , security, lineage, and compliance best practices are followed. Participate in Agile processes, code reviews, documentation, and production support. Skills & Experience 7–12 years of hands-on experience as a Data Engineer or Big Data Engineer . Strong hands-on experience with Azure cloud , including: Azure Databricks Azure Data Factory (ADF) Azure Data Lake Storage (ADLS/Gen2) Azure Synapse/SQL Expert-level proficiency in Apache Spark , Spark SQL, PySpark, or Scala. Experience with Kafka, Spark Streaming, or Flink for streaming pipelines. Strong SQL skills with experience in performance tuning and query optimization . Hands-on experience with ETL tools (ADF, NiFi, Talend, Sqoop, Airflow, etc.). Good understanding of data modeling , warehouse concepts, and distributed systems. Proficiency with Git, Azure DevOps, Jenkins , or similar CI/CD tools. Strong background in Linux/Unix , Bash/PowerShell scripting. Experience with Snowflake, BigQuery, or other cloud DWH solutions is a plus. Familiarity with NoSQL technologies (MongoDB, HBase, Cassandra, Cosmos DB). Preferred Qualifications Experience in on-premise to cloud migration projects. Exposure to machine learning feature pipelines or MLOps workflows. Knowledge of data governance , security practices, and metadata/catalog tools. Certifications in Azure Data Engineer or related cloud technologies.

  • Senior Big Data Specialist

    4 days ago

    rajahmundry, India beBeeDataEngineer Full time

    Data Engineer PositionWe are looking for a skilled professional to fill the role of Data Engineer. This position involves designing, building, and maintaining scalable data pipelines ensuring efficient data integration and enabling advanced analytics and reporting across the organization.Design, develop, and optimize ETL/ELT pipelines using Python, PySpark,...

  • Senior Data Architect

    6 days ago

    rajahmundry, India beBeeData Full time

    About the RoleWe're seeking a seasoned data architect to spearhead the development of our big data ecosystem. The ideal candidate will have extensive hands-on experience in designing, building, and optimizing large-scale data ingestion and transformation pipelines.You will be responsible for crafting robust data acquisition frameworks that support real-time...

  • Senior Data Engineer

    2 weeks ago

    Rajahmundry, India Live Connections Full time

    📌 Hiring: Data Engineer | 9-12 Years Experience | Remote (India) 💰 Salary: Up to 26 LPA 🛠️ Skills: Python, SQL, Big Data, Cloud, SnowflakeJob Description: We are looking for an experienced Data Engineer with strong hands-on expertise in designing and building scalable data pipelines and cloud-based data solutions. The ideal candidate will have...

  • Chief Data Architecture Specialist

    4 days ago

    rajahmundry, India beBeeDataEngineering Full time

    Lead Data Engineer RoleDescription: As a senior data engineering professional, you will be responsible for designing and implementing scalable, fault-tolerant, and maintainable distributed systems. Your expertise in big data technologies such as Apache Spark and real-time streaming technologies like Apache Kafka will enable the development of efficient data...

  • Lead Data Platform Engineer

    2 days ago

    rajahmundry, India beBeeDataGovernance Full time

    Business Intelligence EngineerJob DescriptionWe are seeking an experienced Business Intelligence Engineer to design, implement and maintain large-scale data platforms. This includes defining the overall architecture strategy, developing frameworks for data ingestion, transformation and orchestration, as well as ensuring scalability, reliability and...

  • Principal data engineer

    1 week ago

    rajahmundry, India CodeMyMobile Full time

    Experience Required - 7 to 10 YearsHow to Apply:  Are you a Data Engineer who cares about clean engineering, autonomy, and solving real data challenges? If this sounds like you, we'd love to connect Email your application to with:Your Git Hub links or other professional works.Your resume (PDF or online profile).A Data Engineering project you are...

  • Senior Cloud Data Engineer

    6 days ago

    rajahmundry, India beBeeDataEngineering Full time

    We are seeking a highly skilled Data Engineering professional with strong expertise in cloud infrastructure, Big Data technologies, and distributed data processing frameworks.Design and build scalable, high-performance data pipelines using Azure Databricks, ADF, and Spark.Develop and optimize Spark (Scala/PySpark) jobs for large-volume data processing and...

  • Chief Data Solutions Architect

    6 days ago

    rajahmundry, India beBeeDataEngineer Full time

    Job OverviewWe are seeking an experienced and skilled Data Engineer with a strong background in designing and developing scalable data solutions.The ideal candidate will have deep experience in working with Python, SQL, Big Data ecosystems, and Snowflake, along with a solid understanding of cloud platforms.Develop and optimize large-scale data pipelines and...

  • Data Platform Specialist

    3 hours ago

    rajahmundry, India beBeeEngineering Full time

    Platform Engineering RoleSyntasa is seeking a high-caliber Platform Engineer to join its India subsidiary, Syntasa Technologies India Private Limited. This position offers an exciting opportunity to contribute to the growth of a world-class development and support center.Duties and ResponsibilitiesKey Accountabilities:Design, develop, and optimize data...

  • Cloud-Scale Data Specialist

    4 days ago

    rajahmundry, India beBeeDataEngineer Full time

    Job Summary:Big Data Engineer OpportunityWe are seeking a highly skilled and experienced Big Data Engineer to join our team. This role requires hands-on expertise in designing, building, and maintaining large-scale data systems on the Google Cloud Platform (GCP), specifically with BigQuery and DataProc.The ideal candidate will possess strong problem-solving...