Data Engineer

2 months ago

Any Location, India Reliable Group Full time

POSITION DESCRIPTION :

WHAT YOU'LL DO :

- Architect, Design, document & implement the data pipelines to feed data models for subsequent consumption in Snowflake using dbt, airflow.

- Ensure correctness and completeness of the data being transformed via engineering pipelines for end consumption in Analytical Dashboards.

- Actively monitor and triage technical challenges in critical situations that require immediate resolution.

- Evaluate viable technical solutions and share MVPS or PoCs in support of the research

- Develop relationships with external stakeholders to maintain awareness of data and security issues and trends.

- Review work from other tech team members and provide feedback for growth Implement Data Performance, Data security policies that align with governance objectives and regulatory requirements

YOU'RE GOOD AT :

- You have experience in data warehousing, data modeling, and the building of data engineering pipelines.


- You are well versed in data engineering methods, such as ETL and ELT techniques through scripting and/or tooling.


- You are good in analyzing performance bottlenecks and providing enhancement recommendations; you have a passion for customer service and a desire to learn and grow as a professional and a technologist.

- Strong analytical skills related to working with unstructured datasets. Collaborating with product owners to identify requirements, define desired outcomes and deliver trusted results.

- Building processes supporting data transformation, data structures, metadata, dependency and workload management.

- In this role, SQL is heavily focused. An ideal candidate must have hands-on experience with SQL database design. Plus, Python.

- Demonstrably deep understanding of SQL (level: advanced) and analytical data warehouses (Snowflake preferred).

- Demonstrated ability to write new code i.e., well-documented and stored in a version control system (we use GitHub & Bitbucket)

- Extremely talented in applying SCD, CDC and DQ/DV framework. UDA dependency and workload management.

- In this role, SQL is heavily focused. An ideal candidate must have hands-on experience with SQL database design. Plus, Python.

- Demonstrably deep understanding of SQL (level: advanced) and analytical data warehouses (Snowflake preferred).

- Demonstrated ability to write new code i.e., well-documented and stored in a version control system (we use GitHub & Bitbucket).

- Extremely talented in applying SCD, CDC and DQ/DV framework. Familiar with JIRA & Confluence.

- Must have exposure to technologies such as dbt, Apache airflow and Snowflake.Desire to continually keep up with advancements in data engineering practices. Knowledge on AWS cloud, Python is a plus.

YOU BRING (EXPERIENCE & QUALIFICATIONS) :

Essential Education :

- Bachelor's degree or equivalent combination of education and experience. Bachelor's degree in information science, data management, computer science or related field preferred.

Essential Experience & Job Requirements :

- 5+ years of IT experience with major focus on data warehouse/database related projects


- Must have exposure to technologies such as dbt, Apache Airflow, Snowflake.


- Experience in data platforms: Snowflake, Oracle, SQL Server, MDM etc.

- Expertise in writing SQL and database objects - Stored procedures, functions, views. Hands on experience in ETL/ELT and data security, SQL performance optimization and job orchestration tools and technologies e.g., dbt, Attunity, Golden Gate, APIs, Apache Airflow, etc.

- Experience in data modeling and relational database design Well-versed in applying SCD, CDC, and DQ/DV framework.

- Demonstrate ability to write new code i.e., well-documented and stored in a version control system (we use GitHub & Bitbucket).

- Good to have experience with Cloud Platforms such as AWS, Azure, GCP and Snowflake.

- Good to have strong programming/scripting skills (Python, PowerShell, etc.) Good to know about developing financial models and forecasting to support financial planning and decision-making processes.

- Experience around responsibility for analyzing and interpreting financial data to provide valuable insights and support strategic decision-making.

- Experience working with agile methodologies (Scrum, Kanban) and Meta Scrum with cross-functional teams (Product Owners, Scrum Master, Architects, and data SMEs).

- Excellent written, oral communication and presentation skills to present architecture, features, and solution recommendations

(ref:hirist.tech)

  • Senior Machine Learning Engineer

    3 weeks ago

    Any Location, India K2 Data & Analytics Full time

    Job Description : We are on the lookout for an enthusiastic ML Engineer with over five years of experience to be part of our team, which is focused on developing cutting-edge Video Ad Data technologies. The perfect fit for this role would be someone with a solid grasp of machine learning algorithms and a background in designing and executing large-scale...

  • Senior Machine Learning Engineer

    2 months ago

    Any Location, India K2 Data & Analytics Full time

    Job Description : We are on the lookout for an enthusiastic ML Engineer with over five years of experience to be part of our team, which is focused on developing cutting-edge Video Ad Data technologies. The perfect fit for this role would be someone with a solid grasp of machine learning algorithms and a background in designing and executing large-scale...

  • Senior Machine Learning Engineer

    2 months ago

    Any Location, IN K2 Data & Analytics Full time

    Job Description : We are on the lookout for an enthusiastic ML Engineer with over five years of experience to be part of our team, which is focused on developing cutting-edge Video Ad Data technologies. The perfect fit for this role would be someone with a solid grasp of machine learning algorithms and a background in designing and executing large-scale...

  • Senior Machine Learning Engineer

    3 weeks ago

    Any Location, IN K2 Data & Analytics Full time

    Job Description : We are on the lookout for an enthusiastic ML Engineer with over five years of experience to be part of our team, which is focused on developing cutting-edge Video Ad Data technologies. The perfect fit for this role would be someone with a solid grasp of machine learning algorithms and a background in designing and executing large-scale...

  • Data Engineer

    6 days ago

    Any Location, India Infometry Full time

    Job Description :We are seeking a skilled Data Engineer to join our dynamic team. As a Data Engineer, you will be responsible for designing, developing, and maintaining data pipelines and infrastructure to support our data warehousing and analytics initiatives. You will work closely with cross-functional teams to understand business requirements, design...

  • MLOps Developer

    3 weeks ago

    Any Location, India GOOGNU DATA SERVICES PRIVATE LIMITED Full time

    Job Description : - Design and Implement MLOps Infrastructure: Build and maintain robust MLOps workflows using Azure Machine Learning and other Azure services to automate machine learning lifecycle from data preparation to model deployment and monitoring. - Collaborate with Cross-Functional Teams: Work closely with data scientists, software developers, and...

  • MLOps Developer

    1 month ago

    Any Location, India GOOGNU DATA SERVICES PRIVATE LIMITED Full time

    Job Description : - Design and Implement MLOps Infrastructure: Build and maintain robust MLOps workflows using Azure Machine Learning and other Azure services to automate machine learning lifecycle from data preparation to model deployment and monitoring. - Collaborate with Cross-Functional Teams: Work closely with data scientists, software developers, and...

  • MLOps Developer

    1 month ago

    Any Location, IN GOOGNU DATA SERVICES PRIVATE LIMITED Full time

    Job Description :- Design and Implement MLOps Infrastructure: Build and maintain robust MLOps workflows using Azure Machine Learning and other Azure services to automate machine learning lifecycle from data preparation to model deployment and monitoring.- Collaborate with Cross-Functional Teams: Work closely with data scientists, software developers, and IT...

  • MLOps Developer

    3 weeks ago

    Any Location, IN GOOGNU DATA SERVICES PRIVATE LIMITED Full time

    Job Description :- Design and Implement MLOps Infrastructure: Build and maintain robust MLOps workflows using Azure Machine Learning and other Azure services to automate machine learning lifecycle from data preparation to model deployment and monitoring.- Collaborate with Cross-Functional Teams: Work closely with data scientists, software developers, and IT...

  • Senior Data Engineer

    6 days ago

    Any Location, India Staffington Consulting Pvt Ltd Full time

    Mandatory Skills : Data engineer , AWS Athena, AWS Glue, Redshift, Datalake, Lakehouse, Python, SQL ServerMust Have Experience: 6+ years of hands-on data engineering experience Expertise with AWS services: S3, Redshift, EMR, Glue, Kinesis, DynamoDB Building batch and real-time data pipelines Python, SQL coding for data processing and analysis Data modeling...

  • Senior Data Engineer

    6 days ago

    Any Location, India SportsGameX Full time

    SportsGameX is seeking a highly skilled and experienced Senior Data Engineer to join our data team. This is an exciting opportunity to play a key role in designing and implementing robust data pipelines for our advanced analytics and machine learning applications.Position Overview :As a Senior Data Engineer, you will be responsible for architecting,...

  • Data Engineer

    2 months ago

    Any Location, IN Reliable Group Full time

    POSITION DESCRIPTION :WHAT YOU'LL DO :- Architect, Design, document & implement the data pipelines to feed data models for subsequent consumption in Snowflake using dbt, airflow.- Ensure correctness and completeness of the data being transformed via engineering pipelines for end consumption in Analytical Dashboards.- Actively monitor and triage technical...

  • Data Engineer

    3 weeks ago

    Any Location, IN Reliable Group Full time

    POSITION DESCRIPTION :WHAT YOU'LL DO :- Architect, Design, document & implement the data pipelines to feed data models for subsequent consumption in Snowflake using dbt, airflow.- Ensure correctness and completeness of the data being transformed via engineering pipelines for end consumption in Analytical Dashboards.- Actively monitor and triage technical...

  • Data Engineer

    3 weeks ago

    Any Location, India Edstem Technologies Full time

    Role : Data Engineer Roles : We are looking for Data Engineers for an AI based product development for one of our clients in the banking industry. As a data engineer you will play a pivotal role in collaborating with a team of skilled data engineers to develop and operationalize machine learning models that drive customer satisfaction and enhance our...

  • Data Engineer

    4 weeks ago

    Any Location, IN Edstem Technologies Full time

    Role : Data Engineer Roles : We are looking for Data Engineers for an AI based product development for one of our clients in the banking industry. As a data engineer you will play a pivotal role in collaborating with a team of skilled data engineers to develop and operationalize machine learning models that drive customer satisfaction and enhance our...

  • Data Engineer

    4 weeks ago

    Any Location, India Edstem Technologies Full time

    Role : Data Engineer Roles : We are looking for Data Engineers for an AI based product development for one of our clients in the banking industry. As a data engineer you will play a pivotal role in collaborating with a team of skilled data engineers to develop and operationalize machine learning models that drive customer satisfaction and enhance our...

  • Data Engineer

    3 weeks ago

    Any Location, IN Edstem Technologies Full time

    Role : Data Engineer Roles : We are looking for Data Engineers for an AI based product development for one of our clients in the banking industry. As a data engineer you will play a pivotal role in collaborating with a team of skilled data engineers to develop and operationalize machine learning models that drive customer satisfaction and enhance our...

  • Senior Data Engineer

    3 weeks ago

    Any Location, India UNICO CONNECT PRIVATE LIMITED Full time

    Job Description :Key Responsibilities :- Understand the factories , manufacturing process , data availability and avenues for improvement- Brainstorm , together with engineering, manufacturing and quality problems that can be solved using the acquired data in the data lake platform.- Define what data is required to create a solution and work with...

  • Senior Data Engineer

    3 weeks ago

    Any Location, IN UNICO CONNECT PRIVATE LIMITED Full time

    Job Description :Key Responsibilities :- Understand the factories , manufacturing process , data availability and avenues for improvement- Brainstorm , together with engineering, manufacturing and quality problems that can be solved using the acquired data in the data lake platform.- Define what data is required to create a solution and work with...

  • Data Engineer

    2 weeks ago

    Any Location, India Infometry Full time

    Job Description :We are seeking a skilled Data Engineer to join our dynamic team. As a Data Engineer, you will be responsible for designing, developing, and maintaining data pipelines and infrastructure to support our data warehousing and analytics initiatives. You will work closely with cross-functional teams to understand business requirements, design...