Data Engineer

1 month ago

India NorthStar HR Consultants Full time

Job Title - Data Engineer

Job Location - Baner, Pune, Maharashtra

Domain - Security

About Client -

Our client is on a mission to make security possible. By combining the power of a Security Operations Platform, with security expertise, their customers have increased visibility, the ability to confidently automate across the security lifecycle, and effectively measure and manage risk for continuous improvement.

Why it’s worth it:

Qualified candidates will work closely with cross-functional teams that turn data into critical information and knowledge that can be used to make sound business decisions and business processes. They will gain an in-depth understanding of the cybersecurity business environment and will be responsible for the maintenance and health of tools that ingest data generated by a diverse set of platforms. This position will support our software developers, database architects, analytics engineers, business analysts and data scientists on data initiatives and will ensure optimal data delivery is consistent throughout ongoing projects. This position will also be responsible for data integration between inhouse and commercial applications within the environment.

The everyday hustle:

  • Ability to work with multiple developer teams
  • Complex SQL Query development including performance tuning in Snowflake, Postgres, and SQL Server Environments
  • Develop in Python using object-oriented approach to efficiently create jobs to ingest raw data, transform, and create application integrations
  • Ingest raw data using Python with Snowflake, Postgres, MySQL, Elasticsearch, SQL Server, API, and various other sources and destinations
  • Good to have experience in creating models in dbt (Data Build Tools)
  • Creation and optimization of tables, indexes, stored procedures, views, and functions in Snowflake, Postgres, and SQL Server
  • Creation of Argo CRON Workflows for job orchestration
  • Contribute to multiple GitLab Repositories
  • Basic GitLab CI/CD changes and modifications
  • Work with docker containers for development and modify existing Docker files
  • Work with internal tools that are deployed on Kubernetes (EKS) Pods
  • Responsible for the design, development, implementation and maintenance of Snowflake and Postgres databases
  • Develop and interpret database models
  • Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
  • May work after hours to complete business objectives if required

Do you have what it takes?

  • 2-4 years of Snowflake, Postgres, MSSQL or related Database Development and/or DBA experience
  • Bachelor's degree in Computer Science or related discipline preferred
  • Experience using Snowflake and/or other cloud-based databases / data stores preferred
  • Excellent written and oral communication skills including an ability to communicate with internal and external cross functional teams (technical and business)
  • Great Attitude, Energy, and Effort

  • Data engineer

    2 weeks ago

    India Pacific Data Integrators Full time

    Job Overview We are seeking a skilled Data Engineer to join our team. In this role, you will be responsible for managing and optimizing data pipelines, ensuring the seamless movement of data across systems, and supporting data initiatives through strong technical expertise. The ideal candidate will be proficient in SQL and Python, with hands-on...

  • Data Engineer

    2 weeks ago

    India Pacific Data Integrators Full time

    Job OverviewWe are seeking a skilled Data Engineer to join our team. In this role, you will be responsible for managing and optimizing data pipelines, ensuring the seamless movement of data across systems, and supporting data initiatives through strong technical expertise. The ideal candidate will be proficient in SQL and Python, with hands-on experience in...

  • Data Engineer

    2 weeks ago

    India Pacific Data Integrators Full time

    Job Overview We are seeking a skilled Data Engineer to join our team. In this role, you will be responsible for managing and optimizing data pipelines, ensuring the seamless movement of data across systems, and supporting data initiatives through strong technical expertise. The ideal candidate will be proficient in SQL and Python, with hands-on experience...

  • Data Engineer

    2 weeks ago

    India Pacific Data Integrators Full time

    Job Overview We are seeking a skilled Data Engineer to join our team. In this role, you will be responsible for managing and optimizing data pipelines, ensuring the seamless movement of data across systems, and supporting data initiatives through strong technical expertise. The ideal candidate will be proficient in SQL and Python, with hands-on...

  • Pyspark data engineer

    2 weeks ago

    India ITI Data Full time

    Location : India Type : Full-time Experience : 10 – 13 years Functions : Consulting, Finance, Information Technology, Big Data Engineering Industries : Capital Markets, Investment Banking, Alternative Investments, Financial Services, Management Consulting, Information Technology and Services, Healthcare Job Description We are...

  • Cloud Data Engineering Lead

    4 weeks ago

    India ITI Data Full time

    ITI Data is seeking a highly skilled Cloud Data Engineering Lead to spearhead the design and development of scalable data pipelines on AWS. With a strong background in PySpark, Python, and AWS services, you will be responsible for building robust data integration solutions that enable data-driven insights across various internal and external sources.This is...

  • ITI Data | PySpark Data Engineer

    3 weeks ago

    india ITI Data Full time

    Location : India Type : Full-time Experience : 10 – 13 years Functions : Consulting, Finance, Information Technology, Big Data Engineering Industries : Capital Markets, Investment Banking, Alternative Investments, Financial Services, Management Consulting, Information Technology and Services, Healthcare Job Description We are looking for a PySpark...

  • ITI Data | PySpark Data Engineer

    3 weeks ago

    india ITI Data Full time

    Location : IndiaType : Full-timeExperience : 10 – 13 years Functions : Consulting, Finance, Information Technology, Big Data Engineering Industries : Capital Markets, Investment Banking, Alternative Investments, Financial Services, Management Consulting, Information Technology and Services, HealthcareJob DescriptionWe are looking for a PySpark solutions...

  • PySpark Data Engineer

    3 weeks ago

    India ITI Data Full time

    Location : IndiaType : Full-timeExperience : 10 – 13 years Functions : Consulting, Finance, Information Technology, Big Data Engineering Industries : Capital Markets, Investment Banking, Alternative Investments, Financial Services, Management Consulting, Information Technology and Services, HealthcareJob DescriptionWe are looking for a PySpark solutions...

  • PySpark Data Engineer

    3 weeks ago

    India ITI Data Full time

    Location : India Type : Full-time Experience : 10 – 13 years Functions : Consulting, Finance, Information Technology, Big Data Engineering Industries : Capital Markets, Investment Banking, Alternative Investments, Financial Services, Management Consulting, Information Technology and Services, Healthcare Job Description We are looking for a PySpark...

  • Data Platform Engineer

    4 weeks ago

    India OSD Data Services Full time

    Data Platform EngineerLocation: RemoteType: InternshipAbout UsAt OSD Data, we’re redefining how businesses leverage their data. Our mission is to empower organizations with a seamless, unified, and scalable data infrastructure that enables smarter decision-making and faster innovation. With a focus on data lakehouse technologies, we’ve built a...

  • Data Platform Engineer

    3 weeks ago

    India OSD Data Services Full time

    Data Platform Engineer Location : Remote Type : Internship About Us At OSD Data, we’re redefining how businesses leverage their data. Our mission is to empower organizations with a seamless, unified, and scalable data infrastructure that enables smarter decision-making and faster innovation. With a focus on data lakehouse technologies, we’ve...

  • Pacific Data Integrators | Data Engineer

    6 hours ago

    india Pacific Data Integrators Full time

    Job Overview We are seeking a skilled Data Engineer to join our team. In this role, you will be responsible for managing and optimizing data pipelines, ensuring the seamless movement of data across systems, and supporting data initiatives through strong technical expertise. The ideal candidate will be proficient in SQL and Python, with hands-on experience...

  • Pacific Data Integrators | Data Engineer

    2 weeks ago

    india Pacific Data Integrators Full time

    Job OverviewWe are seeking a skilled Data Engineer to join our team. In this role, you will be responsible for managing and optimizing data pipelines, ensuring the seamless movement of data across systems, and supporting data initiatives through strong technical expertise. The ideal candidate will be proficient in SQL and Python, with hands-on experience in...

  • AWS Data Engineer

    4 months ago

    India ITI Data Full time

    Job Description We are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....

  • OSD Data Services | Data Platform Engineer | india

    3 weeks ago

    india OSD Data Services Full time

    Data Platform Engineer Location : Remote Type : Internship About Us At OSD Data, we’re redefining how businesses leverage their data. Our mission is to empower organizations with a seamless, unified, and scalable data infrastructure that enables smarter decision-making and faster innovation. With a focus on data lakehouse technologies, we’ve built a...

  • OSD Data Services | Data Platform Engineer | india

    4 weeks ago

    india OSD Data Services Full time

    Data Platform EngineerLocation: RemoteType: InternshipAbout UsAt OSD Data, we’re redefining how businesses leverage their data. Our mission is to empower organizations with a seamless, unified, and scalable data infrastructure that enables smarter decision-making and faster innovation. With a focus on data lakehouse technologies, we’ve built a...

  • OSD Data Services | Data Platform Engineer | india

    3 weeks ago

    india OSD Data Services Full time

    Data Platform Engineer Location : Remote Type : Internship About Us At OSD Data, we’re redefining how businesses leverage their data. Our mission is to empower organizations with a seamless, unified, and scalable data infrastructure that enables smarter decision-making and faster innovation. With a focus on data lakehouse technologies, we’ve built a...

  • Big Data Engineer: Scalable Solutions Developer

    3 weeks ago

    India ITI Data Full time

    We are seeking an experienced PySpark Data Engineer to join our team at ITI Data. As a key member of our team, you will design and build scalable data solutions for one of our Fortune 500 Client programs.About the Role:The ideal candidate will have extensive experience in working with Hadoop, NoSQL databases, and Spark framework on Python. You will be...

  • Data Unveil | Quality Assurance Engineer

    3 weeks ago

    india Data Unveil Full time

    About us: At Data Unveil, we believe in delivering the best for our clients (Pharma Companies). We use the latest technology and tools to aggregate and analyze specialty healthcare data received from various data partners. We provide clear and hassle-free business insights to enhance the client’s vision and drive business success. Position Title: QA...