Data Engineer

3 weeks ago

Remote, IN Cloudcover Consultancy Private Limited Full time

Job Overview :

The Data Engineer will be responsible for designing and building modern data platforms to support data-driven decision making. The Data Engineer will execute technical implementation of data engineering and visualization projects.

The Data Engineer will help build a data and analytics consulting practice by taking part in recruiting efforts, creating technical collateral, and staying on top of technology trends with ongoing training and certifications. The entire consulting team will be responsible for building long-term strategic relationships with clients and participating in all aspects of project delivery

Key Responsibilities :

- Design, implement, and develop data pipelines to collect and process large amounts of data from various sources.

- Implement data storage solutions that are scalable, secure, and efficient, such as data warehouses and databases.

- Develop and implement data validation and testing processes to ensure that data is processed accurately and efficiently.

- Automate data collection, processing, and reporting processes to minimize manual work and improve efficiency.

- Create high quality documents to capture problem statements, requirements, solutions and designs.

- Contribute to the development of reusable, repeatable collateral for use across the practice.

- Implement data quality checks and validation processes to ensure the accuracy, consistency, and security of data.

- Monitor data pipelines and processes, troubleshoot issues, and implement solutions to prevent recurrence

- Maintain comprehensive documentation of data architectures, processes, and workflows to facilitate knowledge sharing and collaboration.

Qualifications :

Key Requirements :

- Bachelor's degree in Computer Science, Information Technology, or a related field.

- 3 to 5 years of experience in data management, data engineering, or data visualization.

- Excellent problem-solving, organization, debugging, and analytical skills.

- Ability to work independently and in a team environment.

- Excellent communication skills for effectively expressing ideas to team members and clients.

- Understanding of relational database concepts and SQL querying.

- Knowledge of cloud computing platforms, such as Amazon Web Services (AWS), Google Cloud Platform (GCP), or Microsoft Azure

- Experience building data pipelines with ETL tools/Equivalent Cloud services, such as Azure Data Factory, dbt, AWS Glue, Matillion or equivalent.

- Familiarity with data warehousing solutions, such as Amazon Redshift, Snowflake, Google BigQuery, or Azure Synapse.

- Experience with visualization tools, such as Power BI, Looker, Tableau, and QuickSight.

- Debug and optimize existing data infrastructure and processes as needed.

Nice To Have :

- Experience building large-scale, high throughput, 24x7 data systems.

- Any data engineering, visualization, or data science certifications on any of the clouds.

- Experience with at least one programming language, such as Python, Java, or Vue.

- Exposure to machine learning algorithms, AI, and/or LLM, with implementation in practice.

- Experience with legacy data systems (e.g. Hadoop, Informatica).

- Experience in Migrating Data Engineering workloads from on-prem to cloud or between clouds

- Experience in GCP Data services is preferred

Benefits & Perks For Working At Ollion :


- Our employees multiply their potential because they have opportunities to: Create a lasting Impact, Learn and Grow professionally & personally, Experience great Culture, and Be your Whole Self

- Beyond an amazing, collaborative work environment, great people, and inspiring, innovative work, we have some great benefits and perks:

- Benchmarked, competitive, in-market total rewards package including (but not limited to): base salary & short-term incentive for all employees

- Fully remote-first, small but Global organization; 'learn wherever, whenever' frees our people from a rigid view of learning and growth

- Retirement planning (i.e. CPF, EPF, company-matched 401(k))

- Globally, we build benefit plans that offer choices for whatever stage in life our employees are in and allow for flexibility as life happens.

- Employees have access to a fully comprehensive benefits package to choose the medical, dental, and vision insurance plan that best fits their lives.

- In addition to great healthcare coverage, we also offer all employees mental health resources and additional wellness programs.

- Generous time off and leave allowances

(ref:hirist.tech)

  • Data Engineer

    3 weeks ago

    Remote, IN Comtek Solution Full time

    About us : The Big data engineer will be responsible for the building of critical data infrastructure that surfaces data and insight and be the face to the data user community.You can analyze and test changes to our data architectures and processes and determine what the possible downstream effects and potential impacts to our data consumers,SUMMARY OF...

  • CodeKart - Data Engineer - ETL/Data Warehousing

    3 weeks ago

    Remote, IN CodeKart Full time

    Role : Data Engineer. Experience :3 yr.Location : Remote.Responsibilities :- Provide ongoing support and monitoring for AWS-based data engineering infrastructure. - Ensure the smooth operation of data pipelines and applications in a production environment. - Develop and maintain data pipelines, ETL processes, and data warehouses using AWS services. - Design...

  • Azure Data Engineer

    3 weeks ago

    Remote, IN Racrosoft Technologies Full time

    Role : Azure Data EngineerExp - 4+ years of experienceJob Type : ContractMode of Work : RemoteQualification : - Very Good Communication (Client engagement)- Able to answer Scenario Based Questions on your past work- Able to answer Deep down on certification - Able to answer Past work with deep explanation. - Good exposure to Pyspark - Focus on Azure Data...

  • Data Engineer

    3 weeks ago

    Remote, IN Miratech Full time

    We seek a Middle Data Engineer to join our company remotely.This project is divided into four specialized teams, each responsible for a specific aspect of the development and deployment process. Now in the production phase, the project has established robust pipelines for multiple data sources, managing a variety of automated processes. These pipelines are...

  • Senior AWS Data Engineer

    2 weeks ago

    Remote, IN Quantumbricks Full time

    Job Summary. We are seeking a highly skilled and experienced Senior AWS Data Engineer to lead our cloud data architecture, design, and development initiatives. The ideal candidate will have deep expertise in building and managing large-scale data pipelines and solutions on AWS, as well as strong experience in data architecture, ETL, and real-time data...

  • Data Engineer

    3 weeks ago

    Remote, IN ThinkMove Solutions Full time

    Salary : 14 - 18 LPA Overview :We are seeking a skilled and experienced Data Engineer with a specialization in DataBricks to join our dynamic team. As a Data Engineer, you will play a crucial role in designing, implementing, and maintaining our data infrastructure, with a specific focus on leveraging DataBricks for data processing and analytics. Your...

  • Senior Data Engineer

    3 weeks ago

    Remote, IN CloudHire Full time

    About the job : We are looking for a Data Engineer, for our esteemed client.Client Strategy & Consulting : - Partner with insurance companies to understand their specific business challenges and data landscape.- Develop data-driven strategies to improve operational efficiency, risk management, underwriting, claims processing, and customer experience.-...

  • Data Engineer

    3 weeks ago

    Remote, IN Abs Group Full time

    Profile : Data Engineer (Remote, US Shift)Experience : 5 to 10 YearsAnnual CTC : INR(- ) 1,500,000 to 2,200,000Job Description :- Seeking an experienced Data Engineer who can play a crucial role in the company's fintech data lake project.Technical/Functional Skills :1. 5+ years of experience working in data warehousing systems2. Strong experience in...

  • Data Engineer

    3 weeks ago

    Remote, IN MindTrilogy IT Solutions Pvt. Ltd Full time

    Responsibilities :- Design and implement scalable and efficient data pipelines using Spark, PySpark, and Hive.- Optimize data ingestion, transformation, and loading processes for performance and cost-effectiveness.- Ensure data quality, consistency, and security across the data platform.- Troubleshoot and resolve complex data-related issues.- Collaborate...

  • Senior Azure Data Engineer

    2 weeks ago

    Remote, IN Quantumbricks Full time

    Job Overview : We are seeking a highly skilled and experienced Senior Azure Data Engineer to join our team. The ideal candidate will have over 10 years of experience in designing, developing, and implementing data solutions on Azure. This role involves working closely with cross-functional teams to build scalable, efficient, and secure data platforms. You...

  • Data Engineering

    2 weeks ago

    Remote, IN VSHR UNNATI LLP Full time

    SALARY : 10LPA - 16LPAJob Overview :Our client is seeking an experienced and detail-oriented Data Engineering and Machine Learning Tester to join our Quality Assurance team. The ideal candidate will have strong expertise in testing data pipelines, machine learning models, and large-scale data processing systems, specifically within the Databricks...

  • Snowflake Engineer

    3 weeks ago

    Remote, IN InCommon Full time

    Position Summary :We are looking for seasoned Snowflake Architects and Engineers to join our team and lead the design and implementation of large-scale data solutions on the Snowflake platform. This role is suited for professionals with deep expertise in data architecture and extensive experience with Snowflake.Key Responsibilities : - Lead the architecture,...

  • Data Engineer

    3 weeks ago

    Remote, IN Prime Infosoft Full time

    Job Description :IDC Global is a software development company specializing in web development services for the real estate industry through distributed database technology. While our core models are real estate web search and back-office CRM-based tools, we also focus on database and data processing in order to solve problems and improve the performance of...

  • Senior Data Engineer

    2 weeks ago

    Remote, IN Quantumbricks Full time

    Job Summary : We are seeking a highly skilled Senior Data Engineer with over 10 years of experience in designing, developing, and managing robust data pipelines, with specific expertise in Informatica Intelligent Cloud Services (IICS). The ideal candidate will have extensive experience in handling complex ETL/ELT processes, cloud data integration, and data...

  • Lead Data Engineer

    3 weeks ago

    Remote, IN HNM Solutions Full time

    Job Description :- Develop, and implement ETL processes and data pipelines using Azure Data Factory (ADF), Databricks, and PySpark.- Optimize and manage data workflows to ensure efficient processing and transformation of large datasets.- Develop and maintain data models, schemas, and data integration solutions within the Azure ecosystem.- Ensure data...

  • Azure Data Engineer

    3 months ago

    Remote, IN Talpro Full time

    Azure Data Engineer :We are looking for a skilled and experienced Azure Data Engineer with expertise in ADF (Azure Data Factory), strong RDBMS and SQL skills, and familiarity with Informatica PWC and Oracle PL/SQL. As an Azure Data Engineer, you will be responsible for understanding and converting Informatica PWC and Oracle PL/SQL code into ADF and Azure...

  • Senior Google Cloud Platform Engineer

    3 weeks ago

    Remote, IN Infometry Full time

    Experience : 8 - 10 yrsWe are seeking a highly skilled Senior Data Engineer with extensive experience in data engineering, particularly in building and maintaining data pipelines. This role requires strong expertise in GCP, Dataflow, Apache Beam SDK, and PySpark, along with a deep understanding of Google Cloud Platform (GCP) services. The ideal candidate...

  • Informica - Data Engineer - PySpark/SQL

    3 weeks ago

    Remote, IN Informica Full time

    Experience : 5 to 10 Years.Additional Skills : Fivetran Sksplash view Git Ci/cd Concepts. Job Description :- Seeking an experienced Data Engineer who can play a crucial role in the company's fintech data lake project. Technical/Functional Skills : Must have :- 5+ years of experience working in data warehousing systems.- Strong experience in Oracle Fusion...

  • EXOedge - Data Engineer - MS Fabric

    3 weeks ago

    Remote, IN EXO EDGE INDIA LLP Full time

    EXO Edge is looking for an experienced Data Engineer to join our Data Engineering team. As a Data Engineer, you will design, develop, evaluate, and test data infrastructures. Source system analysis, data modeling, business measure development, and report/visualization formatting. Ensure compliance with policies and procedures, safety, state, and federal...

  • Data Engineer

    3 weeks ago

    Remote, IN Petals Careers Full time

    Responsibilities : - Design, build, and operationalize large-scale enterprise data solutions and applications using one or more of AWS data and analytics services - DynamoDB, RedShift, Kinesis, Lambda, S3 Glue.- Design and develop scalable data pipelines using Databricks and Azure Data Factory. - Implement and optimize data warehousing solutions and Synapse...