Senior Data Engineer

3 weeks ago

Amravati, India Koantek Full time

We are seeking an experienced Databricks Full Stack Data Engineer with 5–6 years of industryexperience. The ideal candidate will have a proven track record of working on live projects,preferably within the manufacturing or energy sectors. He/she will play a key role in developingand maintaining scalable data solutions using Databricks and related technologies.Key Responsibilities:Develop, and deploy end-to-end data pipelines and solutions on Databricks, integrating withvarious data sources and systems.Collaborate with cross-functional teams to understand data, and deliver effective BIsolutions.Implement data ingestion, transformation, and processing workflows using Spark(PySpark/Scala), SQL and Databricks notebooks.Develop and maintain data models, ETL/ELT processes, ensuring high performance,reliability, scalability, and data quality.Build and maintain APIs and data services to support analytics, reporting, and application integration.Ensure data quality, integrity, and security across all stages of the data lifecycle.Monitor, troubleshoot, and optimize pipeline performance in a cloud-based environment.Write clean, modular, and well-documented Python/Scala/SQL/PySpark code.Integrate data from various sources, including APIs, relational and non-relational databases, IoT devices, and external data providers.Ensure adherence to data governance, security, and compliance policies.Required Skills and Experience:Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.5-6 years of hands-on experience in data engineering, with a strong focus on Databricks and Apache Spark.Strong programming skills in Python/PySpark and/or Scala, with a deep understanding of Apache Spark.Experience with Azure Databricks.Strong SQL skills for data manipulation, analysis, and performance tuning.Strong understanding of data structures and algorithms, with the ability to apply them to optimize code and implement efficient solutions.Strong understanding of data architecture, data modeling, ETL/ELT processes, and data warehousing concepts.Experience building and maintaining ETL/ELT pipelines in production environments.Familiarity with Delta Lake, Unity Catalog, or similar technologies.Experience working with structured and unstructured data, including JSON, Parquet, Avro, and time-series data.Familiarity with CI/CD pipelines and tools like Azure DevOps, version control (Git), andDevOps practices for data engineering.Excellent problem-solving skills, attention to detail, and ability to work independently or as part of a team.Strong communication skills to interact with technical and non-technical stakeholders.Preferred Qualifications:Experience with Delta Lake and Databricks Workflows.Exposure to real-time data processing and streaming technologies (Kafka, Spark Streaming).Exposure to the data visualization tool Databricks Genie for data analysis and reporting.Knowledge of data governance, security, and compliance best practices.

  • Senior data scientist

    2 weeks ago

    Amravati, India ValueMatrix.AI Full time

    A Behavioural sciences Deep Tech company. Role Description This is a full-time remote role for a Senior Data Scientist. The Senior Data Scientist will be responsible for performing data analysis, data visualization, and developing data science models. The role involves designing and implementing statistical models, providing insights through data analytics,...

  • Principal Data Engineer

    2 days ago

    amravati, India CodeMyMobile Full time

    Experience Required - 7 to 10 YearsHow to Apply: Are you a Data Engineer who cares about clean engineering, autonomy, and solving real data challenges? If this sounds like you, we'd love to connect Email your application to careers@codemymobile.com with:Your GitHub links or other professional works.Your resume (PDF or online profile).A Data Engineering...

  • Senior Data Engineer

    3 weeks ago

    Amravati, India Celebal Technologies Full time

    Job Summary:We are seeking a highly skilled Data Engineer with deep expertise in Apache Kafka integration with Databricks, structured streaming, and large-scale data pipeline design using the Medallion Architecture. The ideal candidate will demonstrate strong hands-on experience in building and optimizing real-time and batch pipelines, and will be expected...

  • Data engineer

    2 weeks ago

    Amravati, India Recro Full time

    Key Responsibilities include: Data Pipeline Engineering: Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake. AI Data Enablement: Collaborate with AI Consultants to prepare and manage datasets for supervised, unsupervised, and synthetic learning workflows. POC Support:...

  • Data Engineer

    4 weeks ago

    Amravati, India ValueLabs Full time

    Job Title: Lead Data EngineerCompany: ValueLabsLocation: HyderabadNotice Period : Immediate to 15 DaysJob Description:We are seeking a talented Data Engineer to join our dynamic team at ValueLabs. As a Data Engineer, you will be responsible for designing, developing, and maintaining scalable data pipelines that support our business operations. This role...

  • Data Engineer

    4 weeks ago

    Amravati, India ValueLabs Full time

    Job Title: Lead Data EngineerCompany: ValueLabsLocation: HyderabadNotice Period : Immediate to 15 DaysJob Description:We are seeking a talented Data Engineer to join our dynamic team at ValueLabs. As a Data Engineer, you will be responsible for designing, developing, and maintaining scalable data pipelines that support our business operations. This role...

  • Data engineer

    4 weeks ago

    Amravati, India GEMRAJ TECHNOLOGIES LIMITED Full time

    Job Title: Data Engineer Location: RemotePosition: Full-timeExp- Must Have 8+ YearsPosition OverviewWe are currently seeking a Data Engineer to join our technology team. In this role, you will work on building data-driven products that sit atop cloud-based data infrastructure. The ideal candidate is passionate about technology, software design, data...

  • Data Engineer

    4 weeks ago

    Amravati, India Tata Consultancy Services Full time

    Proven expertise in Google Cloud Data Engineering services like BigQuery, Dataproc, and more.Strong programming skills in Python and PySpark for data manipulation and engineering.Solid experience with SQL and NoSQL databases.Deep understanding of data warehousing concepts and hands-on experience with modern data warehousing solutions.Proficiency in designing...

  • Manager, data scientist and machine learning engineer

    2 weeks ago

    Amravati, India Ocwen Financial Solutions Pvt. Ltd. - APAC Full time

    Position Summary: We’re seeking a Data Scientist to support the development and deployment of machine learning models and analytics solutions that improve decision-making across the mortgage lifecycle—from acquisition to servicing. In this hands-on role, you’ll contribute to building predictive models, customer segmentation tools, and automation...

  • Senior Manager, Data Scientist and Machine Learning Engineer

    2 weeks ago

    Amravati, India Ocwen Financial Solutions Pvt. Ltd. - APAC Full time

    POSITION SUMMARY:We are seeking a highly skilled and motivated individual contributor to join our Data Science and Analytics team as a Senior Manager based in India. This hands-on role requires deep expertise in SAS programming, with a strong focus on statistical modeling to support our mortgage and consumer lending businesses. The ideal candidate will be...