Senior Data Engineer

5 days ago

Kakinada, India Koantek Full time

We are seeking an experienced Full Stack Data Engineer with 5–6 years of industry experience. The ideal candidate will have a proven track record of working on live projects, preferably within the manufacturing or energy sectors. He/she will play a key role in developing and maintaining scalable data solutions using PySpark, SQL, and modern data engineering frameworks. Key Responsibilities - Develop and deploy end-to-end data pipelines and solutions integrating with various data sources and systems. - Collaborate with cross-functional teams to understand data requirements and deliver effective BI and analytical solutions. - Implement data ingestion, transformation, and processing workflows using Spark (PySpark/Scala) and SQL. - Develop and maintain data models and ETL/ELT processes, ensuring high performance, scalability, reliability, and data quality. - Build and maintain APIs and data services to support analytics, reporting, and application integration. - Ensure data quality, integrity, and security across all stages of the data lifecycle. - Monitor, troubleshoot, and optimize pipeline performance in a cloud-based environment. - Write clean, modular, and well-documented Python/Scala/SQL/PySpark code. - Integrate data from various sources including APIs, relational/non-relational databases, IoT devices, and external providers. - Ensure adherence to data governance, security, and compliance policies. Required Skills & Experience - Bachelor’s or Master’s degree in Computer Science, Engineering, or related field. - 5-6 years of hands-on experience in Data Engineering, with a strong focus on Apache Spark (PySpark). - Strong programming skills in Python/PySpark and/or Scala, with deep understanding of Apache Spark. - Strong SQL skills for data manipulation, analysis, and performance tuning. - Strong understanding of data architecture, data modeling, ETL/ELT processes, and data warehousing concepts. - Experience building and maintaining ETL/ELT pipelines in production environments. - Experience working with structured and unstructured data, including JSON, Parquet, Avro, and time-series data. - Familiarity with cloud-based data platforms (Azure/AWS/GCP preferred). - Familiarity with CI/CD pipelines and tools like Azure DevOps, Git, and DevOps practices for data engineering. - Excellent problem-solving skills, attention to detail, and ability to work independently or as part of a team. - Strong communication skills for interaction with technical and non-technical stakeholders.

  • Senior data engineer

    4 weeks ago

    Kakinada, India InfoBeans Full time

    About the Job We are seeking a highly skilled Senior Data Engineer – Data Acquisition (ODS) to join our data engineering team. The ideal candidate will have extensive hands-on experience in building and optimizing data ingestion and transformation pipelines using Azure Data Platform , Databricks , Snowflake , and Kafka . You will be responsible for...

  • Senior Data Engineering Professional

    7 days ago

    kakinada, India beBeeDataEngineer Full time

    **Data Engineering Role Overview**We're seeking a highly skilled Senior Data Engineer to join our data and analytics team, supporting the development and enhancement of dimensional data models. This critical role will focus on financial reporting and analytics across the business.You'll work closely with stakeholders to understand complex financial concepts...

  • Senior Data Engineer

    7 days ago

    kakinada, India beBeeDataEngineer Full time

    Data Engineering RoleJob Title: Senior Data Engineer - Python ExpertWe are seeking a seasoned Senior Data Engineer to lead our data engineering efforts and build scalable, automated systems that transform massive, raw datasets into pristine, model-ready formats.Your primary mission will be to architect, build, and own robust, scalable, and automated ETL/ELT...

  • Data Engineer

    7 days ago

    kakinada, India beBeeData Full time

    Job SummaryPrimesoft is looking for an experienced Data Engineer to join our team. As a key member of the Data Products group, you will be responsible for designing and developing data systems, including pipelines, APIs, analytics, AI, and machine learning at scale.This role emphasizes hands-on development, reliability, and collaboration with senior...

  • Senior Data Engineer – Power BI

    5 days ago

    Kakinada, India Innova ESI Full time

    Role: Senior Data Engineer – Power BI / AzureLocation: Bangalore | Gurgaon | Pune | Noida | Hyderabad | ChennaiExperience: 5+ YearsImmediate Joiners Only5+ years of experience in Power BI development Design, develop, and maintain advanced Power BI dashboards and reports Experience with Azure Databricks or Azure Data factory and Spark Experience working...

  • Highly Skilled Data Engineering Specialist

    3 days ago

    kakinada, India beBeeDataEngineer Full time

    About Our Senior Data Engineer RoleWe're seeking a highly skilled Senior Data Engineer to design, build and scale robust data solutions on Microsoft Azure.As a key member of our engineering team, you will own modern data pipelines and models that power analytics and reporting across the business.The ideal candidate will be hands-on with SQL databases, Azure...

  • Principal Data Engineer

    7 days ago

    kakinada, India beBeeData Full time

    Foundry Engineer RoleJob Overview:This role presents a fantastic opportunity for a talented individual to work on a pivotal project utilizing Palantir Foundry and AIP. As part of our team, you will have the chance to design, build, and maintain scalable data pipelines, transformations, and applications within the Palantir ecosystem.Key...

  • Senior Cloud Data Specialist

    5 days ago

    kakinada, India beBeeData Full time

    Job Title: Senior Cloud Data SpecialistOverviewSeeking a seasoned cloud data specialist to spearhead our team's big data strategy. The ideal candidate possesses in-depth knowledge of Google Cloud Platform (GCP) and experience with BigQuery, Airflow, and PySpark.Key ResponsibilitiesTechnical requirement gathering and development of functional specifications...

  • Sr data engineer

    3 weeks ago

    Kakinada, India Futran Solutions Full time

    Job Title: Senior Data Engineer/ Data Engineer Lead Job Description: We are seeking a highly skilled and experienced Senior Data Engineer with a strong background in Microsoft Azure data platforms. The ideal candidate will have a proven track record of designing, implementing, and managing large-scale data solutions using Azure technologies. This role...

  • Senior Cloud Data Specialist

    7 days ago

    kakinada, India beBeeDataEngineer Full time

    Job TitleAzure Data Engineer - Full Remote Senior Position AvailableAbout the JobWe are currently looking for a highly skilled and experienced Azure Data Engineer to join our team. As a senior-level professional, you will be responsible for designing, building, and maintaining data pipelines for enterprise search applications using ADF and Databricks.The...