Current jobs related to Data Engineer - Bangalore - Persistent Systems

  • Data engineer

    2 weeks ago

    Bangalore, India Data Labs - LANDMARK GROUP Full time

    Job Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders. Lead the architecture, design, and delivery of enterprise grade microservices. Deliver assigned projects within budgeted time, cost...

  • Data Engineer

    2 weeks ago

    Bangalore, India Data Labs - LANDMARK GROUP Full time

    Job Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders. Lead the architecture, design, and delivery of enterprise grade microservices. Deliver assigned projects within budgeted time, cost and...

  • Solution Engineer

    1 month ago

    Bangalore, Karnataka, India HEVO DATA Full time

    Overview :. We're seeking a talented Solutions Engineer with strong background in Data Domain to join our growing Sales team. You'll work one-on-one with the sales team to help discover our customers' business and technical needs and demonstrate how Hevo's platform can solve their real-time data replication needs. In this role, you will have...

  • Hevo Data

    1 month ago

    Bangalore, India HEVO DATA Full time

    About Hevo Data : Unleash the power of data at Hevo! Join our team of brilliant minds as we revolutionize the world of data connectivity. Our mission is simple: to empower organisations with seamless access to their data universe, enabling smarter decisions and unlocking their full potential. Are you ready to be part of the data revolution that is shaping...

  • Data Engineer

    2 weeks ago

    bangalore, India Data Labs - LANDMARK GROUP Full time

    Job Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders.Lead the architecture, design, and delivery of enterprise grade microservices. Deliver assigned projects within budgeted time, cost and agreed...

  • Data Engineer

    4 weeks ago

    bangalore, India Data Labs - LANDMARK GROUP Full time

    Job Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders. Lead the architecture, design, and delivery of enterprise grade microservices. Deliver assigned projects within budgeted time, cost and...

  • Data Engineer

    4 weeks ago

    bangalore, India Data Labs - LANDMARK GROUP Full time

    Job Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders.Lead the architecture, design, and delivery of enterprise grade microservices. Deliver assigned projects within budgeted time, cost and agreed...

  • Data Solutions Architect

    1 week ago

    Bangalore, India HEVO DATA Full time

    Overview:We're seeking a talented Solutions Engineer to join our Sales team at Hevo Data. As a Solutions Engineer, you'll work closely with the sales team to understand customers' business and technical needs and demonstrate how our platform can solve their real-time data replication needs.This role requires a deep understanding of our architecture and a...

  • Software Development Engineer II

    1 month ago

    Bangalore, Karnataka, India HEVO DATA Full time

    About Hevo : Ever wondered, what's common between Zepto, Napster, Curefit, Groww, Jumio, Cars24 ? They all super-charge their business growth with Hevo Data Pipelines. How? 2 of every 3 modern day companies are unable to take data driven decision making due to fragmented data across 100s business software. Hevo is a simple, intuitive, and powerful...

  • Solutions Engineer

    1 month ago

    bangalore, India Hevo Data Full time

    Overview : We’re seeking a talented Solutions Engineer with strong background in Data Domain to join our growing Sales team. You’ll work one-on-one with the sales team to help discover our customers’ business and technical needs and demonstrate how Hevo’s platform can solve their real-time data replication needs. In this role, you will have a deep...

  • Senior Engineering Manager

    2 weeks ago

    bangalore, India Hevo Data Full time

    About HevoAt Hevo, we are changing the way companies leverage data to drive user experience, growth, and business processes. There has been a fundamental change in the amount of data companies are generating on a day-to-day basis. More and more users in an organization are now looking to use data to drive business decisions. Data is no longer a second-class...

  • Senior engineering manager

    2 weeks ago

    Bangalore, India Hevo Data Full time

    About Hevo At Hevo, we are changing the way companies leverage data to drive user experience, growth, and business processes. There has been a fundamental change in the amount of data companies are generating on a day-to-day basis. More and more users in an organization are now looking to use data to drive business decisions. Data is no longer a...

  • Senior Engineering Manager

    5 months ago

    bangalore, India Hevo Data Full time

    About HevoAt Hevo, we are changing the way companies leverage data to drive user experience, growth, and business processes. There has been a fundamental change in the amount of data companies are generating on a day-to-day basis. More and more users in an organization are now looking to use data to drive business decisions. Data is no longer a second-class...

  • Senior Engineering Manager

    2 weeks ago

    Bangalore, India Hevo Data Full time

    About Hevo At Hevo, we are changing the way companies leverage data to drive user experience, growth, and business processes. There has been a fundamental change in the amount of data companies are generating on a day-to-day basis. More and more users in an organization are now looking to use data to drive business decisions. Data is no longer a...

  • Senior Engineering Manager

    2 months ago

    Bangalore, India Hevo Data Full time

    About Hevo At Hevo, we are changing the way companies leverage data to drive user experience, growth, and business processes. There has been a fundamental change in the amount of data companies are generating on a day-to-day basis. More and more users in an organization are now looking to use data to drive business decisions. Data is no longer a...

  • Senior Engineering Manager

    1 week ago

    bangalore, India Hevo Data Full time

    About Hevo At Hevo, we are changing the way companies leverage data to drive user experience, growth, and business processes. There has been a fundamental change in the amount of data companies are generating on a day-to-day basis. More and more users in an organization are now looking to use data to drive business decisions. Data is no longer a...

  • Senior Engineering Manager

    1 month ago

    bangalore, India Hevo Data Full time

    About Hevo At Hevo, we are changing the way companies leverage data to drive user experience, growth, and business processes. There has been a fundamental change in the amount of data companies are generating on a day-to-day basis. More and more users in an organization are now looking to use data to drive business decisions. Data is no longer a...

  • Senior Engineering Manager

    1 month ago

    bangalore, India Hevo Data Full time

    About HevoAt Hevo, we are changing the way companies leverage data to drive user experience, growth, and business processes. There has been a fundamental change in the amount of data companies are generating on a day-to-day basis. More and more users in an organization are now looking to use data to drive business decisions. Data is no longer a second-class...

  • Senior Engineering Manager

    4 weeks ago

    Bangalore, India HEVO DATA Full time

    About Hevo : At Hevo, we are changing the way companies leverage data to drive user experience, growth, and business processes. There has been a fundamental change in the amount of data companies are generating on a day-to-day basis. More and more users in an organization are now looking to use data to drive business decisions. Data is no longer a...

  • Software Development Engineer II

    3 weeks ago

    Bangalore, India HEVO DATA Full time

    About Hevo DataWe're a cutting-edge technology company that's revolutionizing the way businesses handle data. Our mission is to make data accessible and easy to use, so everyone can unlock its potential.Job DescriptionWe're looking for a highly skilled Software Development Engineer II to join our team. As a key member of our engineering team, you'll be...

Data Engineer

2 months ago

Bangalore, India Persistent Systems Full time

Note: We are preferring employees from Product organizations and premium Engineering Institutes.

Data Platform Engineer:

  • Assisting team members in designing and building data infrastructure at scale. We handle PB of data each day through streaming and batch processing. You will be helping to deliver data to our data lake for use by our Data Warehouse team, Analytics teams and Data Scientists.
  • Work on Data Lakehouse system architecture and ingesting/pipelining of data, and tools to automateand orchestrate in delivering performance, reliability, and operational efficiency • Define both batch and streaming data-parallel processing pipelines and distributed processing back-ends
  • Build CI/CD Pipelines and manage configuration management
  • Build tools and services that run on k8s that are part of our data ecosystem
  • Routinely write efficient, legible, and well-commented Python
  • Clear communication skills to deliver on complex, technical topics
  • Help scale our data warehouse (we use Snowflake) for clean data-ready delivery for analysis • Work closely with Analytic Engineers and Data Analysts for the collection/analysis of raw data for models that empower end users.
  • Build and scale our warehouse platform for data ingest, logging, search, aggregation, viewing, and analysis

What we're looking for:

  • 5+ years of professional experience working and developing using Python and/or Java • 3+ years of professional experience working with Python scripting experience (Unix, bash, python)
  • AWS Certification or equivalent experience
  • Terraform or other IaC Tools (Terraform Preferred)
  • Experience with Streaming Data Apache Beam, Fink, Spark, and Kafka
  • Experience with modern data technologies such as Airflow, Snowflake, Redshift, Spark • Knowledge of source control, gitflow, gitlabflow, CI/CD (gitlab, circleci)
  • Knowledge/Experience working with Kubernetes, Docker, Helm
  • Experience with automation and orchestration tools
  • Bachelors degree or equivalent in computer science, information systems, or a combination of education and related experience required

Data Engineer:

What You'll Do

  • Lead the building of scalable, fault tolerant pipelines with built in data quality checks that transform, load and curate data from various internal and external systems
  • Provide leadership to cross-functional initiatives and projects.
  • Influence architecture design and decisions.
  • Build cross-functional relationships with Data Scientists, Product Managers and Software Engineers to understand data needs and deliver on those needs.
  • Improve engineering processes and cross-team collaboration.
  • Ruthlessly prioritize work to align with company priorities.
  • Provide thought leadership to grow and evolve DE function and implementation of SDLC best practices in building internal-facing data products by staying up-to-date with • industry trends, emerging technologies, and best practices in data engineering

What we're looking for:

  • 3-12 years of experience in BI and Data Warehousing.
  • Minimum 3 years of experience leading data teams in a high-volume environment • Minimum 4 years of experience with dbt, Airflow and snowflake
  • Experience with Apache Iceberg tables
  • Experience and knowledge of building data-lakes in AWS (i.e. Spark/Glue, Athena), • Including data modeling, data quality best practices, and self-service tooling. • Experience mentoring data professionals from junior to senior levels
  • Demonstrated success leading cross functional initiatives
  • Passionate about data quality, code quality, SLAs and continuous improvement • Deep understanding of data system architecture
  • Deep understanding of ETL/ELT patterns
  • Development experience in at least one object-oriented language (Python,R,Scala, etc.). • Comfortable with SQL and related tooling