Data Engineer

1 week ago


Solapur, India Truelancer.com Full time

Job Title: AWS Data Engineer

Experience: 8-12 Yrs

Must Have Skills: Client Management, Pyspark, Glue, EMR Cluster, Lamda, DMS, ETL, AWS


Required Skills:


  • 8-12 years of experience in Data Engineering
  • Creation and maintenance of optimum data pipeline architecture for ingestion, processing of data
  • Creation of necessary infrastructure for ETL jobs from a wide range of data sources using, S3, Snowflake and AWS data services
  • Experience in Data storage technologies like Amazon S3, SQL, NoSQL
  • Hands on experience in writing complex SQL.
  • Hands on experience in developing pipelines using AWS data services like Glue, Lambda
  • Develop, manage, and optimize data pipelines using AWS Glue and PySpark.
  • Hands on experience in Optimizing AWS services for cost-effectiveness and performance.
  • Data modeling technical awareness
  • Experience in working with stakeholders working in different time zones


Responsibilities:


  • Assist in the design and implementation of Snowflake-based analytics solution (data lake and data warehouse) on AWS
  • Requirements definition, source data analysis and profiling, the logical and physical design of the data lake and data warehouse as well as the design of data integration and publication pipelines
  • Develop Snowflake deployment and usage best practices
  • Build and maintain data pipelines adhering to suggested enterprise architecture principles and guidelines
  • Design, build, test, and maintain data management systems
  • Work in sync with internal and external team members like data architects, data scientists, data analysts to handle all sorts of technical issue.
  • Working in Agile/Lean model
  • Deliver quality deliverables on time
  • Troubleshoot and resolve pipeline and infrastructure issues promptly.
  • Able to understand and translate complex functional requirements into technical solutions with the help of product managers/business analysts.


  • Data Engineering Lead

    3 weeks ago


    Solapur, Maharashtra, India Azilen Technologies Full time

    Company OverviewAzilen Technologies is a leading technology firm that specializes in data engineering and analytics solutions.Job SummaryWe are seeking an experienced Data Engineering Lead to join our team. As a key member of our data engineering group, you will be responsible for designing and developing scalable data pipelines, ensuring high-quality data...

  • Big Data Engineer

    1 month ago


    Solapur, India Pert Telecom Solutions Full time

    Job Description: We are seeking a skilled Big Data Engineer with deep expertise in PySpark, Python, MySQL, Hadoop and Linux. The ideal candidate should have extensive experience deploying and managing these tools within on-premises environments (no public cloud). Proficiency in cluster management, performance optimization, and monitoring is essential for...

  • Senior Data Engineer

    1 month ago


    Solapur, India GS Lab Full time

    Experience Range : 7- 12 Years Responsibilities:Design, implement and maintain scalable ETL jobs and data pipelines for processing and analyzing large data setsBuild warehouses, datalakes and integrations with CRMs and analytics tools.Build and maintain data pipelines using Python for data extraction, transformation and loading (ETL) workflows.Ensure high...


  • Solapur, India MPC Cloud Consulting Pvt Ltd Full time

    We are looking for Data Analytics Engineers Key Details:Role: Data Analytics Engineer (5-8 years of experience, ability to work independently) Skillset: Azure Data Factory, Azure Synapse Analytics, and other Azure services. SQL Server, Azure SQL Python software development stacks, ecosystems, frameworks, and tools such as NumPy, SciPy, Pandas, sci-kit-learn...

  • Senior Data Engineer

    3 months ago


    Solapur, India VidPro Consultancy Services Full time

    Role: Senior Databricks Engineer / Databricks Technical Lead/ Data ArchitectExperience: 3-15 yearsLocation: Bangalore, Chennai, Delhi, Pune, Kolkata and GurgaonMandatory Skills: Python/ PySpark / Spark with Azure/ Azure Databricks / Azure DataFactoryPrimary Roles and Responsibilities:● Developing Modern Data Warehouse solutions using Databricks and AWS/...

  • Data Science Engineer

    3 weeks ago


    Solapur, India RecourseTech Full time

    Recourse Tech is a dynamic and fast-growing software and technology agency that builds cutting-edge solutions for businesses across industries. We specialize in delivering high-impact, data-driven solutions, leveraging advanced technologies, and empowering organizations with actionable insights.We are looking for a Data Science Engineer with 1-3 years of...


  • Solapur, Maharashtra, India Hexaware Technologies Full time

    Hexaware Technologies is a leading IT consulting and business solutions company that offers end-to-end services to clients worldwide. Our team of experts provides innovative solutions to businesses, helping them achieve their goals and stay ahead in the market.We are seeking an experienced Snowflake Data Engineer who will play a key role in designing,...


  • Solapur, Maharashtra, India Cardinal Health Full time

    About UsAt Cardinal Health, we are a leading distributor of pharmaceuticals and a global manufacturer and distributor of medical and laboratory products. We strive to be the most trusted partner in healthcare by delivering innovative digital solutions and end-to-end services that advance healthcare and improve lives.We have a long history of success, with...

  • GCP Data Engineer

    1 month ago


    Solapur, India True Tech Professionals Full time

    Notice Period: Only 15 days or less will be consideredLocation: Remote (But will have to visit Gurgaon or Bangalore office – as and when required)Experience: 5 Plus YearsRoles/Responsibilities (Candidate’s responsibilities):Experience in GCP, Google BigQuery (Including BQ query standards, partitioning/clustering, data-model)Python Programming ExpertSQL...

  • Data Modeler

    5 days ago


    Solapur, India Akshya Patra Services Full time

    We are seeking a highly skilled and experienced Data Modeller to join our growing data team.In this role, you will be responsible for designing and developing robust and scalable data models that effectively capture and represent business information.You will work closely with data engineers, analysts, and business stakeholders to translate complex business...

  • Data Analyst

    3 weeks ago


    Solapur, India snooplay.in Full time

    Location: Noida (Full time)Education: B.Tech (preferred)About Snooplay:Snooplay is India’s leading marketplace for toys and games, where data drives every decision. With multiple data nodes fueling our platform, we rely on meaningful insights to improve experiences for parents and children. If you’re passionate about digging into data, deriving patterns,...


  • Solapur, India v4c.ai Full time

    Overview: As the apex of the data science hierarchy, the Principal Data Scientist will set the strategic direction for data-driven initiatives, ensuring alignment with organizational goals, and lead in the adoption of advanced technologies including Machine Learning, Deep Learning, and Generative AI.Job Description:Strategically lead the planning and...


  • Solapur, Maharashtra, India v4c Full time

    Overview:v4c is a leading innovator in the data science industry, shaping the future of technology and business.Salary: $250,000 - $350,000 per yearJob Description:Data Science ProjectsWe are seeking an exceptional Principal Data Scientist to lead strategic planning and execution of innovative data science projects, focusing on Machine Learning, Deep...


  • Solapur, India Gravity Infosolutions Full time

    Role: Sr. Data Architect-ContractExperience: 14-20 yearsShift: Regular IST shiftType: ContractDuration: 6 monthsLocation: Mumbai-Hybrid(2 Days Work from Office in a week)Job Description:We are seeking an accomplished Senior Data Architect to join our team and lead our data architecture efforts. As a Senior Data Architect, you will be responsible for...

  • Lead DevOps Engineer

    1 month ago


    Solapur, India DDN Full time

    This is an incredible opportunity to be part of a company that has been at the forefront of AI and high-performance data storage innovation for over two decades. DataDirect Networks (DDN) is a global market leader renowned for powering many of the world's most demanding AI data centers, in industries ranging from life sciences and healthcare to financial...


  • solapur, India Cognitio Analytics Inc Full time

    Experience:1 to 8 years - DA/ Sr. DA/ AM /ManagerMust Haves:Python/PySpark SQL Advanced ExcelComm Skills Data Analysis and interpretation Project Management Story Telling Interest and ability to get to grips with the underlying business problem and value drivers of a projectGood to have:FlaskTeam ManagementAny kind of health care background eg, -...

  • Sr. DevOps Engineer

    1 month ago


    Solapur, India ZingHR Full time

    Job Title- : Sr. DevOps EngineerLocation: Mumbai (On- Site)About ZingHR:ZingHR is an industry-leading HR technology company dedicated to providing scalable, secure, and compliant HR solutions. Our focus on innovation includes integrating advanced DevOps and SecOps practices to ensure the robustness, security, and compliance of our platform across global...


  • Solapur, India Intuit Full time

    As a Staff Software Engineer in the Infrastructure Engineering team, you will be responsible for developing automation solutions to improve operational excellence across Unified Communications, Endpoint Engineering, and Network Engineering. Your focus will be on creating tools and systems that enhance monitoring, reduce incident response times, and improve...

  • Software Engineer

    3 weeks ago


    Solapur, India Saaras Inc Full time

    Saaras enables companies to Connect, Secure and Observe modern applications – APIs, Microservices and Data – with the industry’s leading API Platform (“EnRoute”).Our product powers cloud applications for our US based customers for SaaS, On-Premise and Federal deployments. About the role.This is a full-time remote role for a Software Engineer (Go)...

  • Staff IOS Engineer

    2 months ago


    Solapur, India Jio Full time

    Job descriptionRole & responsibilities- Play a key role in developing our Design System, serving designers and engineers across the entire organization.- Implement concepts, user experiences, and user interfaces in our design system.- Collaborate closely with the designers in your team and support them in finding the best solution for every component.- Teach...