Data Engineer PostGres and DataBricks

2 days ago

Cochin, Kerala, India Digital Biz Solutions Full time

Dbiz is a high-performing product and engineering company that partners with organizations to build digital solutions using the right technology at the right time. We pride ourselves on our innovative approach, leveraging technology in diverse and impactful ways.


We are looking for an Experienced Data Engineer with a strong background in DataBricks or PostgreSQL, and proficiency in Python or Azure cloud data engineering. The ideal candidate will have at least 3 years of experience in a Data Engineering role and possess a deep understanding of data management and ETL processes. Responsibilities:
  • Design, construct, install, test, and maintain highly scalable data management systems.
  • Develop and maintain scalable data pipelines and build out new API integrations to support continuing increases in data volume and complexity.
  • Collaborate with stakeholders including the Executive, Product, Data, and Design teams to address data-related technical issues and support their data infrastructure needs.
  • Develop processes for data mining, data modeling, and data production.
  • Work closely with data scientists and architects on multiple projects.
  • Ensure systems meet business requirements and adhere to industry practices.
  • Integrate new data management technologies and software engineering tools into existing structures.
  • Create custom software components and analytics applications.
Requirements:
  • Minimum of 3
  •  years of experience in a Data Engineering role.
  • Proficiency in DataBricks or PostgreSQL.
  • Proficiency in Python or experience with Azure cloud data engineering.
  • Proven experience in building and optimizing big data pipelines, architectures, and data sets.
  • Experience in performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
  • Strong experience in data modeling, ETL development, and data warehousing, or similar skills.
  • Strong project management and organizational skills.
  • Experience supporting and working with cross-functional teams in a dynamic environment.
Nice to Have:
  • Experience with AWS or other cloud services.
  • Experience with big data tools such as Hadoop, Spark, Kafka, etc.
  • Experience with relational SQL and NoSQL databases.
  • Familiarity with Salesforce.
Why Join Us:
  • Be part of a dynamic team that is shaping the future of data engineering
  • Engage with cutting-edge technologies and innovative projects.
  • Opportunity to collaborate with a diverse group of professionals in a fast-paced environment.

Life at Dbiz
  • Competitive salary and attractive benefits.
  • Dynamic and innovative work environment.
  • Opportunities for personal growth and development.
  • Engaging and collaborative company culture.

  • Sr. Databricks Engineer

    1 day ago

    Cochin, Kerala, India Milestone Technologies, Inc. Full time

    In this vital role you will be responsible for the development and implementation of our data strategy. The ideal candidate possesses a strong blend of technical expertise and data-driven problem-solving skills. As a Data Engineer, you will play a crucial role in building, and optimizing our data pipelines and platforms in a SAFE Agile product team.Chip in...

  • Data Engineer

    1 week ago

    Cochin, Kerala, India ChiSquarelabs Full time ₹ 8,00,000 - ₹ 12,00,000 per year

    We are looking for a highly skilled Data Engineer with expertise in PySpark and Databricks to design, build, and optimize scalable data pipelines for processing massive datasets.IMMEDIATE JOINERS PREFERREDResponsibilitiesBuild & Optimize Pipelines: Develop high-throughput ETL workflows using PySpark on Databricks.Data Architecture & Engineering: Work on...

  • Enterprise Databricks Platform Production Support

    5 days ago

    Cochin, Kerala, India Litmus7 Full time

    3+ years of experience in production support of the Databricks platform.Implement and maintain the Databricks platform on AWS.Develop and maintain automation scripts and tools for platform provisioning and routine tasks using Terraform.Install, configure, and maintain Databricks clusters and workspaces.Implement, and maintain the Databricks platform,...

  • Senior Data Engineer

    2 weeks ago

    Cochin, Kerala, India Milestone Technologies, Inc. Full time

    Role Overview:Seeking an experienced Senior Data Engineer to lead data ingestion, transformation, and optimization initiatives using the modern Apache and Azure data stack. The role involves working on scalable pipelines, large-scale distributed systems, and data lake management.Core Responsibilities:· Build and manage high-volume data pipelines using...

  • Lead Data Engineer

    1 week ago

    Cochin, Kerala, India Tothr Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    7+ years of hands-on experience in data engineering roles 3+ years in a technical leadership position, managing data engineering Proven track record of building and maintaining BI/analytics platforms • Experience with Databricks and Delta Lake

  • Senior .NET Core, Azure, DevOps, and Databricks Engineer

    1 day ago

    Cochin, Kerala, India Digital Biz Solutions Full time

    Key Responsibilities:   Application Development• Design, develop, and maintain high-performance applications using .NET Core.• Collaborate with cross-functional teams to translate business requirements into technical solutions.•  Develop and integrate APIs that support seamless retail operations.   Cloud Architecture & Azure Solutions• Architect,...

  • Data Architect

    2 days ago

    Cochin, Kerala, India Reply Full time

    We are seeking a Data Architect with deep experience designing and implementing scalable, secure, and high-performance cloud data platforms. Ideal candidates will have solid Databricks expertise, strong knowledge of Azure data services, and hands-on architecture experience building modern data ecosystems including big data, metadata management, and...

  • Sr. Data Engineer

    3 days ago

    Cochin, Kerala, India Litmus7 Full time

    6+ years of experience in Data Engineer to design and implement scalable data solutions.Deep expertise in cloud data warehousing, ETL/ELT processes, data modeling, and business intelligence.Support design and implementation of end-to-end data solutions leveraging AWS Redshift, Apache Airflow, dbt, and other modern data tools including DataBricks.Experience...

  • Senior Data Engineer

    2 weeks ago

    Cochin, Kerala, India Milestone Technologies Full time

    Company OverviewMilestone Technologies is a global IT managed services firm that partners with organizations to scale their technology, infrastructure and services to drive specific business outcomes such as digital transformation, innovation, and operational agility. Milestone is focused on building an employee-first, performance-based culture and for over...

  • Senior Data Engineer

    1 day ago

    Cochin, Kerala, India Digital Biz Solutions Full time

    About the Company:Dbiz is a high-performing product & engineering company that partners up with organizations to help build out digital solutions with the right technology at the right time, whilst being innovative by using technology in different ways.  Requirements:  Azure Synapse Analytics/ Azure Databricks Azure Cloud , Azure Data Lake , Azure...