Data Engineer
2 months ago
Job Description :
Responsibilities :
- Designing and implementing data pipelines to collect, clean, and transform data from various sources
- Building and maintaining data storage and processing systems, such as databases, data warehouses, and data lakes
- Ensuring data is properly secured and protected
- Developing and implementing data governance policies and procedures
- Collaborating with data analysts, data scientists, and other stakeholders to understand their data needs and ensure they have access to the data they need
- Sharing knowledge with the wider business, working with other BA's and technology teams to make sure processes and ways of working is documented.
- Collaborate with Big Data Solution Architects to design, prototype, implement, and optimize data ingestion pipelines so that data is shared effectively across various business systems.
- Ensure the design, code and procedural aspects of solution are production ready, in terms of operational, security and compliance standards.
- Participate in day-to-day project and agile meetings and provide technical support for faster resolution of issues.
- Clearly and concisely communicating to the business, on status of items and blockers.
- Have an end-to-end knowledge of the data landscape within Lebara.
Skills & Experience :
- 6+ years of design & development experience with big data technologies
- Proficient in Python, PySpark
- 2+ years of development experience in cloud technologies like Azure, AWS or GCP
- Proficient in querying and manipulating data from various DB (relational and big data).
- Experience of writing effective and maintainable unit and integration tests for ingestion pipelines.
- Experience of using static analysis and code quality tools and building CI/CD pipelines.
- Excellent communication, problem-solving, and leadership skills, and be able to work well in a fast-paced, dynamic environment.
- Experience of working on high-traffic and large-scale Software Products
-
Azure Data Architect
6 months ago
Remote, India Data PlatformExperts Full timeJob Description: Azure Data Engineer (Architect Level) We are seeking an experienced and highly skilled Azure Data Engineer at the Architect level to lead the design and implementation of complex data solutions on the Microsoft Azure platform. As an Azure Data Engineer Architect, you will be responsible for providing technical expertise, guiding the...
-
Azure Data Architect
5 months ago
Remote, India Data PlatformExperts Full time**Job Description: Azure Data Architect** **Key Responsibilities**: - **Design and Implementation**: - Design and implement end-to-end data solutions (data models, pipelines, data lakes, data warehouses) in Azure. - Optimize and maintain existing Azure data structures and integration processes. - Ensure architectural solutions are scalable, maintainable,...
-
Senior Java Engineer
4 weeks ago
Remote, India Data caliper Full timeJob Title: Senior Java EngineerAbout the Role:Data Caliper is seeking a highly skilled Senior Java Engineer to lead the development of our Java-based applications. The successful candidate will have a deep understanding of Java programming principles and will be able to design, develop, and maintain robust and scalable Java applications.Key...
-
Data Engineer
1 month ago
Remote, India CodeKart Full timeJob Title: Data EngineerAt CodeKart, we are seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data processing systems.Key Responsibilities:Design and implement data pipelines using AWS services such as EMR, Glue, and Lambda.Develop and maintain data...
-
Data Engineer
1 month ago
Remote, India Abs Group Full timeJob Title: Data EngineerAt Abs Group, we are seeking an experienced Data Engineer to play a crucial role in our fintech data lake project.Key Responsibilities:Design and implement data ingestion pipelines from Oracle Fusion Cloud to a Data Bricks environment.Develop and maintain data transformation/ETL skills using Spark SQL, Spark, and Unity Catalog in Data...
-
Data Engineer
1 month ago
Remote, India ThinkMove Solutions Full timeCompensation: ₹14 - ₹18 LPA Overview:We are seeking a skilled and experienced Data Engineer with a specialization in DataBricks to drive our data infrastructure forward. As a Data Engineer, you will play a pivotal role in designing, implementing, and maintaining our data infrastructure, with a specific focus on leveraging DataBricks for data processing...
-
Data Engineer
1 month ago
Remote, India Cloudcover Consultancy Private Limited Full timeJob OverviewThe Data Engineer will be responsible for designing and building modern data platforms to support data-driven decision making. The Data Engineer will execute technical implementation of data engineering and visualization projects.Key ResponsibilitiesDesign, implement, and develop data pipelines to collect and process large amounts of data from...
-
Data Engineer
4 weeks ago
Remote, India EXO EDGE INDIA LLP Full timeAt EXO EDGE INDIA LLP, we are seeking a skilled Data Engineer to oversee the design, development, and evaluation of data infrastructures. As a Data Engineer, you will be responsible for ensuring the accuracy, reliability, and consistency of data, as well as developing data visualizations and reports to facilitate business decision-making.Key responsibilities...
-
Data Engineer
1 month ago
Remote, India Comtek Solution Full timeAbout us : The Big data engineer will be responsible for the building of critical data infrastructure that surfaces data and insight and be the face to the data user community. You can analyze and test changes to our data architectures and processes and determine what the possible downstream effects and potential impacts to our data consumers, SUMMARY OF...
-
Data Engineer
1 month ago
Remote, India Glow Touch Full timeJob Title: Data Engineer - Scalable Data PipelinesOverview: We are seeking a skilled Data Engineer to join our dynamic team at GlowTouch Technologies. The ideal candidate will be responsible for designing, building, and maintaining scalable data pipelines and architectures that support our data-driven decision-making processes.Key Responsibilities:Design,...
-
Data Engineer
4 weeks ago
Remote, India Nthinsight Full timeData Infrastructure ExpertiseAt Nthinsight, we seek a skilled and experienced Data Engineer to join our dynamic and innovative team. As a key member of our data infrastructure team, you will play a crucial role in designing, developing, and maintaining our data infrastructure to support the organization's data needs. You will collaborate with...
-
Azure Data Engineer
5 days ago
Remote, India Yallo Management Consultancies L.L.C Full timeRole Type: Contract Location: Remote Duration: 6 months+ Start: ASAP Job Role: As an Azure Data Engineer, you will play a crucial role in designing, developing, and maintaining data engineering solutions on the Azure cloud platform. You will collaborate with cross-functional teams to understand data requirements, architect scalable data pipelines, and ensure...
-
Senior Data Engineer
4 weeks ago
Remote, India Miratech Full timeAbout the RoleWe are seeking a skilled Data Engineer to join our team at Miratech. The successful candidate will play a key role in designing, developing, and maintaining our data infrastructure.Key ResponsibilitiesDesign and implement data pipelines using Big Data technologies such as Azure Cloud, Databricks, Hadoop, and Spark.Collaborate with...
-
Data Engineering Specialist
1 month ago
Remote, India VSHR UNNATI LLP Full timeJob Title: Data Engineering SpecialistJob Overview:VSHR UNNATI LLP is seeking a highly skilled Data Engineering Specialist to join our Quality Assurance team. The ideal candidate will have strong expertise in testing data pipelines, machine learning models, and large-scale data processing systems, specifically within the Databricks environment.Key...
-
Big Data Engineer
4 weeks ago
Remote, India Overture Rede Private Limited. Full timeData Engineering SpecialistOverture Rede Private Limited is seeking a highly skilled Data Engineering Specialist to join our team. This is a unique opportunity to work on complex data platforms and data engineering solutions. The ideal candidate will have a minimum of 8 years of experience in building complex data platforms and data engineering solutions,...
-
GlowTouch Data Engineer
4 weeks ago
Remote, India Glow Touch Full timeJob OverviewWe are searching for a skilled Data Engineer to contribute to the growth of our dynamic team at GlowTouch. The ideal candidate will be responsible for designing and building scalable data pipelines and architectures that support our data-driven decision-making processes. You will collaborate closely with data scientists, analysts, and other...
-
Data Scientist and Engineer
4 weeks ago
Remote, India MindTrilogy IT Solutions Pvt. Ltd Full timeAbout the RoleThe ideal candidate will have strong expertise in designing and implementing scalable and efficient data pipelines using Spark, PySpark, and Hive. The role also involves optimizing data ingestion, transformation, and loading processes for performance and cost-effectiveness. Ensuring data quality, consistency, and security across the data...
-
Data Platform Engineer
4 weeks ago
Remote, India Yellow Full timeAbout the RoleWe are looking for an experienced Data Platform Engineer to join our team at Yellow. As a key member of our fast-paced team, you will work closely with senior engineers to design, implement, and optimize data pipelines and systems using cutting-edge open-source tools.Key ResponsibilitiesDesign and build scalable ETL/ELT pipelines using tools...
-
Azure Data Engineer
1 month ago
Remote, India Racrosoft Technologies Full timeRole: Cloud Data EngineerExperience: 4+ years of experience in designing and implementing data engineering solutions on Azure.Job Type: ContractWork Mode: RemoteQualifications:- Excellent communication skills for client engagement- Ability to answer scenario-based questions on past work- Strong understanding of Azure certifications- Ability to explain past...
-
Data Engineer
2 months ago
Remote, IN Cloudcover Consultancy Private Limited Full timeJob Overview :The Data Engineer will be responsible for designing and building modern data platforms to support data-driven decision making. The Data Engineer will execute technical implementation of data engineering and visualization projects.The Data Engineer will help build a data and analytics consulting practice by taking part in recruiting efforts,...