Data Engineer

3 weeks ago


Delhi, India NorthStar HR Consultants Full time
Job Title - Data Engineer
Job Location - Baner, Pune, Maharashtra
Domain - Security
About Client -
Our client is on a mission to make security possible. By combining the power of a Security Operations Platform, with security expertise, their customers have increased visibility, the ability to confidently automate across the security lifecycle, and effectively measure and manage risk for continuous improvement.
Why it’s worth it:
Qualified candidates will work closely with cross-functional teams that turn data into critical information and knowledge that can be used to make sound business decisions and business processes. They will gain an in-depth understanding of the cybersecurity business environment and will be responsible for the maintenance and health of tools that ingest data generated by a diverse set of platforms. This position will support our software developers, database architects, analytics engineers, business analysts and data scientists on data initiatives and will ensure optimal data delivery is consistent throughout ongoing projects. This position will also be responsible for data integration between inhouse and commercial applications within the environment.
The everyday hustle:
Ability to work with multiple developer teams
Complex SQL Query development including performance tuning in Snowflake, Postgres, and SQL Server Environments
Develop in Python using object-oriented approach to efficiently create jobs to ingest raw data, transform, and create application integrations
Ingest raw data using Python with Snowflake, Postgres, MySQL, Elasticsearch, SQL Server, API, and various other sources and destinations
Good to have experience in creating models in dbt (Data Build Tools)
Creation and optimization of tables, indexes, stored procedures, views, and functions in Snowflake, Postgres, and SQL Server
Creation of Argo CRON Workflows for job orchestration
Contribute to multiple GitLab Repositories
Basic GitLab CI/CD changes and modifications
Work with docker containers for development and modify existing Docker files
Work with internal tools that are deployed on Kubernetes (EKS) Pods
Responsible for the design, development, implementation and maintenance of Snowflake and Postgres databases
Develop and interpret database models
Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
May work after hours to complete business objectives if required
Do you have what it takes?
2-4 years of Snowflake, Postgres, MSSQL or related Database Development and/or DBA experience
Bachelor's degree in Computer Science or related discipline preferred
Experience using Snowflake and/or other cloud-based databases / data stores preferred
Excellent written and oral communication skills including an ability to communicate with internal and external cross functional teams (technical and business)
Great Attitude, Energy, and Effort

  • delhi, India Data Warehouse Engineer Full time

    Experience : 2- 5 YearsPrimary Skills : Strong SQL knowledge, Data warehouse concepts and ETL hands on experience, Azure services like Data Factory, Azure Data Lake, and Good analysis skills.Good to have skills: Power BI, Databricks, Python.


  • Delhi, India Data Warehouse Engineer Full time

    Experience : 2- 5 YearsPrimary Skills : Strong SQL knowledge, Data warehouse concepts and ETL hands on experience, Azure services like Data Factory, Azure Data Lake, and Good analysis skills.Good to have skills: Power BI, Databricks, Python.


  • delhi, India Senior Data Integration Engineer Full time

    Must Have Skills/Skill Requirement:Design and architect integration solutions to connect various enterprise applications, systems, and databases.Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications.Utilize Azure Integration Services such as Azure Logic Apps,...


  • Delhi, India Senior Data Integration Engineer Full time

    Must Have Skills/Skill Requirement:Design and architect integration solutions to connect various enterprise applications, systems, and databases.Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications.Utilize Azure Integration Services such as Azure Logic Apps,...


  • Delhi, India Senior Data Integration Engineer Full time

    Must Have Skills/Skill Requirement:- Design and architect integration solutions to connect various enterprise applications, systems, and databases.- Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications.- Utilize Azure Integration Services such as Azure Logic...


  • Delhi, India Senior Data Integration Engineer Full time

    Must Have Skills/Skill Requirement:Design and architect integration solutions to connect various enterprise applications, systems, and databases.Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications.Utilize Azure Integration Services such as Azure Logic Apps,...

  • Lead data engineer

    3 weeks ago


    Delhi, India Wavicle Data Solutions Full time

    Job Description:We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering.As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions.Your proficiency in Python, Py Spark, AWS, Databricks, SQL, and leadership skills will be crucial for success.Key Responsibilities:Lead...


  • Delhi, India OSD Data Services Full time

    Data Platform EngineerLocation: RemoteType: InternshipAbout UsAt OSD Data, we’re redefining how businesses leverage their data. Our mission is to empower organizations with a seamless, unified, and scalable data infrastructure that enables smarter decision-making and faster innovation. With a focus on data lakehouse technologies, we’ve built a...


  • Delhi, India OSD Data Services Full time

    Data Platform Engineer Location : RemoteType : InternshipAbout Us At OSD Data, we’re redefining how businesses leverage their data. Our mission is to empower organizations with a seamless, unified, and scalable data infrastructure that enables smarter decision-making and faster innovation. With a focus on data lakehouse technologies, we’ve...


  • Delhi, India OSD Data Services Full time

    Data Platform EngineerLocation : RemoteType : InternshipAbout UsAt OSD Data, we’re redefining how businesses leverage their data. Our mission is to empower organizations with a seamless, unified, and scalable data infrastructure that enables smarter decision-making and faster innovation. With a focus on data lakehouse technologies, we’ve built a...

  • AWS Data Engineer

    4 weeks ago


    delhi, India ITI Data Full time

    Job Description We are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....

  • AWS Data Engineer

    1 month ago


    delhi, India ITI Data Full time

    Job DescriptionWe are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources. There...

  • AWS Data Engineer

    4 months ago


    Delhi, India ITI Data Full time

    Job DescriptionWe are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources. There...

  • Aws data engineer

    4 weeks ago


    Delhi, India ITI Data Full time

    Job DescriptionWe are looking for an AWS Data with primary skills on Py Spark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....


  • Delhi, India OSD Data Services Full time

    Data Platform Engineer Location : RemoteType : InternshipAbout Us At OSD Data, we’re redefining how businesses leverage their data. Our mission is to empower organizations with a seamless, unified, and scalable data infrastructure that enables smarter decision-making and faster innovation. With a focus on data lakehouse technologies, we’ve built a...


  • Delhi, India Data Unveil Full time

    About us: At Data Unveil, we believe in delivering the best for our clients (Pharma Companies). We use the latest technology and tools to aggregate and analyze specialty healthcare data received from various data partners. We provide clear and hassle-free business insights to enhance the client’s vision and drive business success.Position Title: QA...


  • Delhi, Delhi, India Hevo Data Full time

    About Hevo DataWe are a cutting-edge data integration platform that empowers businesses to unlock the full potential of their data.Salary: $70,000 - $100,000 per annumJob DescriptionWe are seeking an exceptional Business Development Representative to join our team. As a key member of our sales organization, you will play a critical role in identifying and...


  • Delhi, India Anicca Data Science Solutions Full time

    Job descriptionAnicca Data is seeking a motivated Software Engineer who is eager to tackle complex challenges and apply their skills to innovative solutions. This role will primarily focus on developing code to manage large-scale data and working with intricate data structures. The successful candidate will contribute to existing codebases or create...


  • delhi, India Hevo Data Full time

    Hevo is hiring for a passionate Sales Development Representative with an eagle-eye view who can identify the right prospects in need of our solution to make their life easy. Job Role : You should be on top of your account book and engage with prospects. Introduce and position Hevo as a one-stop solution for all their data integration and pipeline...


  • Delhi, India Data Unveil Full time

    About us: At Data Unveil, we believe in delivering the best for our clients (Pharma Companies). We use the latest technology and tools to aggregate and analyze specialty healthcare data received from various data partners. We provide clear and hassle-free business insights to enhance the client’s vision and drive business success.Position Title: QA...