Data Engineer
4 weeks ago
Data Engineer
Bangalore
Experience - 5 to 8 yrs
JOB DESCRIPTION
We are seeking experienced, motivated and enthusiastic Data Engineering Specialists to join our team. As part of the team, you will be involved in the implementation of the ongoing and new initiatives for our company and contribute to our mission of delivering high-quality data-driven solutions to our clients.
Must Have Skills: DBT, Snowflake, Azure OCR, FiveTran, Communication, ELT/ETL, Python
Experience: 3 to 5 years
Role Description:
The data engineering role requires creating and managing technical solutions on the modern data stack (Snowflake, dbt, fivetran, Azure), architecting, building, and managing data flows/pipelines and construct data models within Snowflake to be used for other downstream processes or for analysis purposes.
Role Responsibility:
• Design, develop, and maintain scalable data pipelines and analytics solutions using DBT, Snowflake, and technologies related
· Collaborate with stakeholders to gather requirements and translate business needs into technical solutions
· Develop efficient code with unit testing and code documentation
· Ensuring accuracy and integrity of data and applications through analysis, coding, documenting, testing, and problem
solving
· Optimize and fine-tune data models, SQL queries, and transformations for performance and scalability
· Design, develop, and maintain scalable data models and transformations using DBT in conjunction with Snowflake,
ensure the effective transformation and load data from diverse sources into data warehouse or data lake.
· Integrate FiveTran connectors to streamline data ingestion from various sources into Snowflake
· Develop custom Python scripts and functions to automate data workflows and enhance system capabilities
· Provide technical expertise and support to resolve data-related issues and troubleshoot system failures
· Collaborate with the API development team to integrate data pipelines with external systems and applications
· Contribute to the development of web-based data visualization solutions and dashboards
· Communicate with all the project stakeholders on the project status
· Manage, monitor, and ensure the security and privacy of data to satisfy business needs
· Contribute to the automation of modules, wherever required
· Stay updated on emerging trends and technologies in data engineering, cloud computing, and analytics domains
EXPERTISE AND QUALIFICATIONS
Role Requirements:
· Bachelor's degree in Computer Science, Engineering, or a related field
· Proven experience of at least 5 years as a data engineer, ETL developer, or similar role, with a focus on DBT and Snowflake
· Strong proficiency in SQL and database concepts, with hands-on experience in Snowflake data warehouse
· Subject Matter expert of Data warehouse and Data Lake concepts (Dimensional Modelling, change data capture, slowly
changing dimensions etc.)
· Proficiency in programming languages such as Python for data manipulation, automation, and scripting
· Knowledgeable in relational databases, nonrelational databases, data pipelines (ELT/ETL), and file stores
· Knowledgeable in performance tuning and optimization
· Experience with cloud platforms like Azure and tools like Azure OCR for data extraction and processing
· Familiarity with data integration tools like FiveTran
· Knowledge of API development principles and experience integrating data pipelines with external systems
· Proficient in written, verbal and presentation communication (English)
· Ability to work effectively in a fast-paced, collaborative environment and manage multiple priorities
· Excellent analytical, problem-solving, and communication skills
-
india Senior Data Integration Engineer Full timeMust Have Skills/Skill Requirement:Design and architect integration solutions to connect various enterprise applications, systems, and databases.Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications.Utilize Azure Integration Services such as Azure Logic Apps,...
-
india Senior Data Integration Engineer Full timeMust Have Skills/Skill Requirement: Design and architect integration solutions to connect various enterprise applications, systems, and databases. Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications. Utilize Azure Integration Services such as Azure Logic Apps,...
-
Senior Data Integration Engineer
24 hours ago
India Senior Data Integration Engineer Full timeMust Have Skills/Skill Requirement: Design and architect integration solutions to connect various enterprise applications, systems, and databases. Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications. Utilize Azure Integration Services such as Azure Logic...
-
Lead data engineer
7 days ago
India Wavicle Data Solutions Full timeJob Description: We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering. As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions. Your proficiency in Python, Py Spark, AWS, Databricks, SQL, and leadership skills will be crucial for success. Key...
-
Lead Data Engineer
2 weeks ago
India Wavicle Data Solutions Full timeJob Description:We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering.As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions.Your proficiency in Python, PySpark, AWS, Databricks, SQL, and leadership skills will be crucial for success.Key Responsibilities:Lead...
-
Lead Data Engineer
2 weeks ago
India Wavicle Data Solutions Full timeJob Description: We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering. As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions. Your proficiency in Python, PySpark, AWS, Databricks, SQL, and leadership skills will be crucial for success. Key...
-
Aws data engineer
4 days ago
India ITI Data Full timeJob Description We are looking for an AWS Data with primary skills on Py Spark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....
-
AWS Data Engineer
3 months ago
India ITI Data Full timeJob Description We are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....
-
AWS Data Engineer
3 weeks ago
India ITI Data Full timeJob Description We are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....
-
AWS Data Engineer
3 weeks ago
india ITI Data Full timeJob Description We are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....
-
AWS Data Engineer
3 months ago
India ITI Data Full timeJob DescriptionWe are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources. There...
-
AWS Data Engineer
3 months ago
India ITI Data Full timeJob Description We are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....
-
Lead Data Engineer: Strategic Data Architect
2 weeks ago
India Wavicle Data Solutions Full timeWavicle Data Solutions is seeking an experienced Lead Data Engineer to play a pivotal role in architecting and implementing data solutions.About the RoleThis position offers a competitive salary of $180,000 - $220,000 per annum, commensurate with experience. Key ResponsibilitiesDesign and develop scalable and efficient data pipelines using Python and...
-
india Wavicle Data Solutions Full timeJob Description: We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering. As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions. Your proficiency in Python, PySpark, AWS, Databricks, SQL, and leadership skills will be crucial for success. Key Responsibilities:...
-
india Wavicle Data Solutions Full timeJob Description:We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering.As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions.Your proficiency in Python, PySpark, AWS, Databricks, SQL, and leadership skills will be crucial for success.Key Responsibilities:Lead...
-
india Wavicle Data Solutions Full timeJob Description: We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering. As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions. Your proficiency in Python, PySpark, AWS, Databricks, SQL, and leadership skills will be crucial for success. Key Responsibilities:...
-
Data engineer
1 month ago
India Ryden Global Full timeWe're #hiring #Data Engineers for our USA based client at offshore in India (must support afternoon shift in IST). Role Description This is a full-time/contract remote role for a Data Engineer at Ryden Global. The Data Engineer will be responsible for data engineering tasks such as data modeling, ETL processes, data warehousing, and data analytics...
-
Data Engineer
1 month ago
india Ryden Global Full timeWe're #hiring #DataEngineers for our USA based client at offshore in India (must support afternoon shift in IST). Role DescriptionThis is a full-time/contract remote role for a Data Engineer at Ryden Global. The Data Engineer will be responsible for data engineering tasks such as data modeling, ETL processes, data warehousing, and data analytics on a...
-
Data Engineer
1 month ago
India Ryden Global Full timeWe're #hiring #DataEngineers for our USA based client at offshore in India (must support afternoon shift in IST). Role Description This is a full-time/contract remote role for a Data Engineer at Ryden Global. The Data Engineer will be responsible for data engineering tasks such as data modeling, ETL processes, data warehousing, and data analytics on a...
-
Data Engineer
1 month ago
india Ryden Global Full timeWe're #hiring #DataEngineers for our USA based client at offshore in India (must support afternoon shift in IST). Role Description This is a full-time/contract remote role for a Data Engineer at Ryden Global. The Data Engineer will be responsible for data engineering tasks such as data modeling, ETL processes, data warehousing, and data analytics on a...
