Senior Data Engineer

8 hours ago

Amravati, India Koantek Full time

We are seeking an experienced Databricks Full Stack Data Engineer with 5–6 years of industryexperience. The ideal candidate will have a proven track record of working on live projects,preferably within the manufacturing or energy sectors. He/she will play a key role in developingand maintaining scalable data solutions using Databricks and related technologies.Key Responsibilities:Develop, and deploy end-to-end data pipelines and solutions on Databricks, integrating withvarious data sources and systems.Collaborate with cross-functional teams to understand data, and deliver effective BIsolutions.Implement data ingestion, transformation, and processing workflows using Spark(PySpark/Scala), SQL and Databricks notebooks.Develop and maintain data models, ETL/ELT processes, ensuring high performance,reliability, scalability, and data quality.Build and maintain APIs and data services to support analytics, reporting, and application integration.Ensure data quality, integrity, and security across all stages of the data lifecycle.Monitor, troubleshoot, and optimize pipeline performance in a cloud-based environment.Write clean, modular, and well-documented Python/Scala/SQL/PySpark code.Integrate data from various sources, including APIs, relational and non-relational databases, IoT devices, and external data providers.Ensure adherence to data governance, security, and compliance policies.Required Skills and Experience:Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.5-6 years of hands-on experience in data engineering, with a strong focus on Databricks and Apache Spark.Strong programming skills in Python/PySpark and/or Scala, with a deep understanding of Apache Spark.Experience with Azure Databricks.Strong SQL skills for data manipulation, analysis, and performance tuning.Strong understanding of data structures and algorithms, with the ability to apply them to optimize code and implement efficient solutions.Strong understanding of data architecture, data modeling, ETL/ELT processes, and data warehousing concepts.Experience building and maintaining ETL/ELT pipelines in production environments.Familiarity with Delta Lake, Unity Catalog, or similar technologies.Experience working with structured and unstructured data, including JSON, Parquet, Avro, and time-series data.Familiarity with CI/CD pipelines and tools like Azure DevOps, version control (Git), andDevOps practices for data engineering.Excellent problem-solving skills, attention to detail, and ability to work independently or as part of a team.Strong communication skills to interact with technical and non-technical stakeholders.Preferred Qualifications:Experience with Delta Lake and Databricks Workflows.Exposure to real-time data processing and streaming technologies (Kafka, Spark Streaming).Exposure to the data visualization tool Databricks Genie for data analysis and reporting.Knowledge of data governance, security, and compliance best practices.

  • (Urgent Search) Senior Data Engineer

    3 weeks ago

    Amravati, India CareerXperts Consulting Full time

    We are looking for a highly skilled Senior Data Engineer to design, build, and optimize scalable data pipelines and infrastructure. The ideal candidate will have strong expertise in modern data engineering tools and frameworks, along with the ability to collaborate closely with data scientists, analysts, and product teams to deliver reliable and efficient...

  • Senior Data Engineer

    12 hours ago

    Amravati, India Celebal Technologies Full time

    Job Summary:We are seeking a highly skilled Data Engineer with deep expertise in Apache Kafka integration with Databricks, structured streaming, and large-scale data pipeline design using the Medallion Architecture. The ideal candidate will demonstrate strong hands-on experience in building and optimizing real-time and batch pipelines, and will be expected...

  • Senior lead data engineer

    3 weeks ago

    Amravati, India TerraFinn Technologies Full time

    Company DescriptionTerra Finn Technologies outsources scholars from various top business schools in India and experienced employees to Fintech companies globally. The company focuses on providing expert employees to help fintech companies grow their business and achieve their goals efficiently. Terra Finn Technologies values long-term relationships with both...

  • Data Engineer

    4 days ago

    Amravati, India ValueLabs Full time

    Job Title: Lead Data EngineerCompany: ValueLabsLocation: HyderabadNotice Period : Immediate to 15 DaysJob Description:We are seeking a talented Data Engineer to join our dynamic team at ValueLabs. As a Data Engineer, you will be responsible for designing, developing, and maintaining scalable data pipelines that support our business operations. This role...

  • Data Engineer

    4 days ago

    Amravati, India ValueLabs Full time

    Job Title: Lead Data EngineerCompany: ValueLabsLocation: HyderabadNotice Period : Immediate to 15 DaysJob Description:We are seeking a talented Data Engineer to join our dynamic team at ValueLabs. As a Data Engineer, you will be responsible for designing, developing, and maintaining scalable data pipelines that support our business operations. This role...

  • Data engineer

    4 days ago

    Amravati, India GEMRAJ TECHNOLOGIES LIMITED Full time

    Job Title: Data Engineer Location: RemotePosition: Full-timeExp- Must Have 8+ YearsPosition OverviewWe are currently seeking a Data Engineer to join our technology team. In this role, you will work on building data-driven products that sit atop cloud-based data infrastructure. The ideal candidate is passionate about technology, software design, data...

  • Data Architect

    2 weeks ago

    Amravati, India Mastech Digital Full time

    Position: Staff, Data Engineer - Data ArchitectureLocation: Spire T110, Hyderabad Knowledge City, Madhapur, Hyderabad, Telangana, India, 500081Duration: Full timeComplete onsite (5 days/week)Job Description:Roles & Responsibilities:Shape and drive enterprise-wide data architecture strategy: Define and evolve the long-term technical vision for scalable,...

  • Data Engineer

    1 week ago

    Amravati, India Tata Consultancy Services Full time

    Proven expertise in Google Cloud Data Engineering services like BigQuery, Dataproc, and more.Strong programming skills in Python and PySpark for data manipulation and engineering.Solid experience with SQL and NoSQL databases.Deep understanding of data warehousing concepts and hands-on experience with modern data warehousing solutions.Proficiency in designing...

  • Senior Engineer – AI

    3 weeks ago

    Amravati, India IntraEdge Full time

    Seeking a hands-on Senior Engineer with proven expertise in Artificial Intelligence (AI/ML) and Java development. This role combines deep technical skills with the ability to design, build, and optimize AI-powered enterprise applications. The engineer will be responsible for developing scalable Java-based systems, integrating AI/ML models into production,...

  • Databricks Data Engineer

    2 weeks ago

    Amravati, India Insight Global Full time

    ** Immediate Joiner **Insight Global is seeking a Databricks Data Engineer in India with with 3–5 years of experience to support data engineering initiatives in the pharmaceutical domain. The ideal candidate will have hands-on expertise in Databricks, SQL, and Python, and a strong understanding of pharma/life sciences data. This role involves building and...