Data Engineer

3 weeks ago

Any Location, IN Reliable Group Full time

POSITION DESCRIPTION :

WHAT YOU'LL DO :

- Architect, Design, document & implement the data pipelines to feed data models for subsequent consumption in Snowflake using dbt, airflow.

- Ensure correctness and completeness of the data being transformed via engineering pipelines for end consumption in Analytical Dashboards.

- Actively monitor and triage technical challenges in critical situations that require immediate resolution.

- Evaluate viable technical solutions and share MVPS or PoCs in support of the research

- Develop relationships with external stakeholders to maintain awareness of data and security issues and trends.

- Review work from other tech team members and provide feedback for growth Implement Data Performance, Data security policies that align with governance objectives and regulatory requirements

YOU'RE GOOD AT :

- You have experience in data warehousing, data modeling, and the building of data engineering pipelines.


- You are well versed in data engineering methods, such as ETL and ELT techniques through scripting and/or tooling.


- You are good in analyzing performance bottlenecks and providing enhancement recommendations; you have a passion for customer service and a desire to learn and grow as a professional and a technologist.

- Strong analytical skills related to working with unstructured datasets. Collaborating with product owners to identify requirements, define desired outcomes and deliver trusted results.

- Building processes supporting data transformation, data structures, metadata, dependency and workload management.

- In this role, SQL is heavily focused. An ideal candidate must have hands-on experience with SQL database design. Plus, Python.

- Demonstrably deep understanding of SQL (level: advanced) and analytical data warehouses (Snowflake preferred).

- Demonstrated ability to write new code i.e., well-documented and stored in a version control system (we use GitHub & Bitbucket)

- Extremely talented in applying SCD, CDC and DQ/DV framework. UDA dependency and workload management.

- In this role, SQL is heavily focused. An ideal candidate must have hands-on experience with SQL database design. Plus, Python.

- Demonstrably deep understanding of SQL (level: advanced) and analytical data warehouses (Snowflake preferred).

- Demonstrated ability to write new code i.e., well-documented and stored in a version control system (we use GitHub & Bitbucket).

- Extremely talented in applying SCD, CDC and DQ/DV framework. Familiar with JIRA & Confluence.

- Must have exposure to technologies such as dbt, Apache airflow and Snowflake.Desire to continually keep up with advancements in data engineering practices. Knowledge on AWS cloud, Python is a plus.

YOU BRING (EXPERIENCE & QUALIFICATIONS) :

Essential Education :

- Bachelor's degree or equivalent combination of education and experience. Bachelor's degree in information science, data management, computer science or related field preferred.

Essential Experience & Job Requirements :

- 5+ years of IT experience with major focus on data warehouse/database related projects


- Must have exposure to technologies such as dbt, Apache Airflow, Snowflake.


- Experience in data platforms: Snowflake, Oracle, SQL Server, MDM etc.

- Expertise in writing SQL and database objects - Stored procedures, functions, views. Hands on experience in ETL/ELT and data security, SQL performance optimization and job orchestration tools and technologies e.g., dbt, Attunity, Golden Gate, APIs, Apache Airflow, etc.

- Experience in data modeling and relational database design Well-versed in applying SCD, CDC, and DQ/DV framework.

- Demonstrate ability to write new code i.e., well-documented and stored in a version control system (we use GitHub & Bitbucket).

- Good to have experience with Cloud Platforms such as AWS, Azure, GCP and Snowflake.

- Good to have strong programming/scripting skills (Python, PowerShell, etc.) Good to know about developing financial models and forecasting to support financial planning and decision-making processes.

- Experience around responsibility for analyzing and interpreting financial data to provide valuable insights and support strategic decision-making.

- Experience working with agile methodologies (Scrum, Kanban) and Meta Scrum with cross-functional teams (Product Owners, Scrum Master, Architects, and data SMEs).

- Excellent written, oral communication and presentation skills to present architecture, features, and solution recommendations

(ref:hirist.tech)

  • Senior Machine Learning Engineer

    2 months ago

    Any Location, IN K2 Data & Analytics Full time

    Job Description : We are on the lookout for an enthusiastic ML Engineer with over five years of experience to be part of our team, which is focused on developing cutting-edge Video Ad Data technologies. The perfect fit for this role would be someone with a solid grasp of machine learning algorithms and a background in designing and executing large-scale...

  • Senior Machine Learning Engineer

    3 weeks ago

    Any Location, IN K2 Data & Analytics Full time

    Job Description : We are on the lookout for an enthusiastic ML Engineer with over five years of experience to be part of our team, which is focused on developing cutting-edge Video Ad Data technologies. The perfect fit for this role would be someone with a solid grasp of machine learning algorithms and a background in designing and executing large-scale...

  • MLOps Developer

    1 month ago

    Any Location, IN GOOGNU DATA SERVICES PRIVATE LIMITED Full time

    Job Description :- Design and Implement MLOps Infrastructure: Build and maintain robust MLOps workflows using Azure Machine Learning and other Azure services to automate machine learning lifecycle from data preparation to model deployment and monitoring.- Collaborate with Cross-Functional Teams: Work closely with data scientists, software developers, and IT...

  • MLOps Developer

    3 weeks ago

    Any Location, IN GOOGNU DATA SERVICES PRIVATE LIMITED Full time

    Job Description :- Design and Implement MLOps Infrastructure: Build and maintain robust MLOps workflows using Azure Machine Learning and other Azure services to automate machine learning lifecycle from data preparation to model deployment and monitoring.- Collaborate with Cross-Functional Teams: Work closely with data scientists, software developers, and IT...

  • Data Engineer

    3 weeks ago

    Any Location, IN Edstem Technologies Full time

    Role : Data Engineer Roles : We are looking for Data Engineers for an AI based product development for one of our clients in the banking industry. As a data engineer you will play a pivotal role in collaborating with a team of skilled data engineers to develop and operationalize machine learning models that drive customer satisfaction and enhance our...

  • Data Engineer

    3 weeks ago

    Any Location, IN Edstem Technologies Full time

    Role : Data Engineer Roles : We are looking for Data Engineers for an AI based product development for one of our clients in the banking industry. As a data engineer you will play a pivotal role in collaborating with a team of skilled data engineers to develop and operationalize machine learning models that drive customer satisfaction and enhance our...

  • Senior Data Engineer

    3 weeks ago

    Any Location, IN UNICO CONNECT PRIVATE LIMITED Full time

    Job Description :Key Responsibilities :- Understand the factories , manufacturing process , data availability and avenues for improvement- Brainstorm , together with engineering, manufacturing and quality problems that can be solved using the acquired data in the data lake platform.- Define what data is required to create a solution and work with...

  • Data Engineer

    2 weeks ago

    Any Location, IN Infometry Full time

    Job Description :We are seeking a skilled Data Engineer to join our dynamic team. As a Data Engineer, you will be responsible for designing, developing, and maintaining data pipelines and infrastructure to support our data warehousing and analytics initiatives. You will work closely with cross-functional teams to understand business requirements, design...

  • Data Engineer

    3 weeks ago

    Any Location, IN Muoro Full time

    Responsibilities :- Design, develop, and maintain robust data pipelines using Apache Spark, Python, and other relevant technologies.- Implement data ingestion processes from various sources, ensuring data quality and integrity.- Optimize and tune data pipelines for performance and scalability.- Collaborate with data scientists and analysts to deploy machine...

  • Data Engineer

    2 months ago

    Any Location, IN Muoro Full time

    Responsibilities :- Design, develop, and maintain robust data pipelines using Apache Spark, Python, and other relevant technologies.- Implement data ingestion processes from various sources, ensuring data quality and integrity.- Optimize and tune data pipelines for performance and scalability.- Collaborate with data scientists and analysts to deploy machine...

  • Senior Data Engineer

    3 weeks ago

    Any Location, IN Innova ESI Full time

    About the Role :We are seeking a highly skilled and experienced Senior Data Engineer to join our growing team. This is a remote-first position, offering you the flexibility to work from anywhere while collaborating effectively with colleagues. In this role, you will play a key role in the entire data lifecycle, from designing and implementing data pipelines...

  • Senior Data Engineer

    3 weeks ago

    Any Location, IN Muoro Full time

    Role & Responsibilities:- Design, architect, and develop code in a testable, scalable, and performant manner. - Work closely with Product Managers, Cross Product Engineers and Data Engineers to optimize and deliver innovative solutions. - Build a team that mines, analyzes, and transforms large [un]structured datasets, collaborating with analysts, data...

  • Senior Data Engineer

    2 months ago

    Any Location, IN Muoro Full time

    Role & Responsibilities:- Design, architect, and develop code in a testable, scalable, and performant manner. - Work closely with Product Managers, Cross Product Engineers and Data Engineers to optimize and deliver innovative solutions. - Build a team that mines, analyzes, and transforms large [un]structured datasets, collaborating with analysts, data...

  • Senior Data Engineer

    3 weeks ago

    Any Location, IN Coders Brain Technology Pvt. Ltd. Full time

    Position Name : Sr Data EngineerExperience Required : 8+yearsSalary : As per the Market Standard or Else whatever budget you haveNotice period : Immediate joiner Job Type : Full timeLocation : RemoteJob Description :Solution Architect (Databricks) :Candidate having 8+ years of total experience in Data engineering (development/design), in which at least 5+...

  • Senior Data Engineer

    3 weeks ago

    Any Location, IN Coders Brain Technology Pvt. Ltd. Full time

    Position Name : Sr Data EngineerExperience Required : 8+yearsSalary : As per the Market Standard or Else whatever budget you haveNotice period : Immediate joiner Job Type : Full timeLocation : RemoteJob Description :Solution Architect (Databricks) :Candidate having 8+ years of total experience in Data engineering (development/design), in which at least 5+...

  • Data Engineer

    3 weeks ago

    Any Location, IN Suitable.AI Full time

    Role : .Net Core you will do :- Architect, Design, document & implement the data pipelines to feed data models for subsequent consumption in Snowflake using DBT, airflow.- Ensure correctness and completeness of the data being transformed via engineering pipelines for end consumption in Analytical Dashboards.- Actively monitor and triage technical challenges...

  • Data Engineer

    3 weeks ago

    Any Location, IN Suitable.AI Full time

    Role : .Net Core you will do :- Architect, Design, document & implement the data pipelines to feed data models for subsequent consumption in Snowflake using DBT, airflow.- Ensure correctness and completeness of the data being transformed via engineering pipelines for end consumption in Analytical Dashboards.- Actively monitor and triage technical challenges...

  • Azure Data Engineer

    2 months ago

    Any Location, IN Visionyle Full time

    Position Name: Azure Data EngineerPosition Mode: PermanentExperience: 6 YearsJoining Location: RemoteNotice: ImmediateMode of Interview : 2-3 roundsSUMMARY:Azure Data Engineer should have experience on Azure data lake, Azure SQL database, Databricks, Azure Data Factory, and Azure SQL data warehouse and controlling and granting database access and migrating o...

  • Azure Data Engineer

    3 weeks ago

    Any Location, IN Visionyle Full time

    Position Name: Azure Data EngineerPosition Mode: PermanentExperience: 6 YearsJoining Location: RemoteNotice: ImmediateMode of Interview : 2-3 roundsSUMMARY:Azure Data Engineer should have experience on Azure data lake, Azure SQL database, Databricks, Azure Data Factory, and Azure SQL data warehouse and controlling and granting database access and migrating o...

  • SportsGameX - Senior Data Engineer - ETL

    5 days ago

    Any Location, IN SportsGameX Full time

    SportsGameX is seeking a highly skilled and experienced Senior Data Engineer to join our data team. This is an exciting opportunity to play a key role in designing and implementing robust data pipelines for our advanced analytics and machine learning applications.Position Overview : As a Senior Data Engineer, you will be responsible for architecting,...