Senior Data Engineer

3 weeks ago


Remote, IN Nthinsight Full time

Job Description :

We are seeking a skilled and experienced Data Engineer with expertise in Python, data warehousing, ETL (Extract, Transform, Load), and SQL. As a Data Engineer, you will play a crucial role in designing, developing, and maintaining our data infrastructure to support the organization's data needs. You will collaborate with cross-functional teams to ensure the effective collection, storage, and retrieval of data for analytics and reporting purposes.

Responsibilities :

1 Work with product managers and data analysts to build data products that power our business.

2 Build and maintain data analytics reports, ETL /ELT pipelines, data lakes, and streaming solutions.

3 Analyze new data sources and work with stakeholders to understand the impact of integrating new data into existing pipelines and models

4 Develop & maintain critical data pipelines, using tools such as Apache Airflow, to ensure highly accurate and reliable business reporting

5 Perform ad-hoc analysis and provide insights to stakeholders within the organization such as Marketing, Growth & Sales teams to drive prioritization.

6 Create data visualizations and analytic reports using various tools such as Tableau

7 Optimize database queries to improve and maintain performance on very large data sets.

8 Work closely with the business and analysis team for the deliverables.

Requirements :

1. 8+ years of relevant experience. Masters or Bachelors degree in CS/ML/AI or equivalent discipline.

2. Expertise with coding with Pyspark, Pandas and visualizations with Tableau.

3. Scheduling/orchestrating pipelines using Databricks and Airflow.

4. Expertise with data querying (Snowflake, SQL, Redshift, Spark) and analyzing billions of rows of data points.

5. Familiarity with SQL, especially within cloud-based data warehouses like Snowflake, Google Big Query, and Amazon Redshift

6. Strong understanding of relational DB such as MySQL/PostgreSQL, document-based storage systems such as MongoDB or CouchDB, key-value stores (Memcached, Redis), Column-oriented stores (HBase, Cassandra), graph-oriented stores; their distinct advantages, disadvantages, and trade-offs.

7. Experience building machine learning, statistical, and analytical model, and tuning parameters.

8. Experience designing experiments and extracting insights.

9. Knowledge of various ETL/ ELT techniques and frameworks

If you are a motivated end to end Data Analyst with a passion for building robust and scalable data solutions, we invite you to apply and contribute to our dynamic and innovative team.

(ref:hirist.tech)
  • Senior Data Engineer

    3 weeks ago


    Bangalore/Remote, IN Geektrust.in Full time

    Role : Senior Data EngineerFocus : AWS ecosystemKey Responsibilities : Designing, developing, and maintaining data pipelines; ensuring the reliability, efficiency, and scalability of data infrastructure; collaborating with cross-functional teams.Primary Skills : Programming Languages : PythonDatabase : SQL.- AWS Services : Proficient with a variety of AWS...


  • remote, IN AdAstra Full time

    Job Description :As a Senior Power BI Developer, you will be responsible for : Technical Requirements :- Gathering and Development of Functional Specifications - Translating business needs into technical specifications. - Developing reporting systems that provide accessible information for decision-making. - Using warehouse data to generate reports to...


  • Remote, IN Samagra Transforming Governance Full time

    We are searching for an experienced Senior Software Engineer to join our team. The ideal candidate will have a strong background in backend software development using solid server-side technologies including TypeScript, Postgres, and Docker/Kubernetes deployment. You will play a pivotal role in designing, developing, and maintaining critical software...


  • Remote, IN Prime Infosoft Full time

    Roles And Responsibilities:- Architect, build and integrate end-to-end life cycles of large-scale, distributed machine learning systems i.e. ML Ops using cutting-edge tools/frameworks. - Develop tools and services for explainability of ML solutions.- Implement distributed cloud GPU training approaches for deep learning models. - Build software/tools that...


  • Remote, IN Etta Global Partners LLC Full time

    Job Description :We are seeking a talented Senior DevOps Engineer with 6 to 8 years of experience and a proven track record in designing, implementing, and managing cloud infrastructure solutions on AWS. The ideal candidate will have a deep understanding of DevOps principles and practices, coupled with hands-on experience across a range of AWS services and...

  • Data Engineer

    3 weeks ago


    Pune/Hyderabad/Remote, IN HARP Technologies and Services Full time

    Job Location : Pune & Hyderabad (Initial 1 -2 months hybrid and then complete remote job. Client will offer accommodation(stay), food & travel exp. )Exp range : 6+ years Shift timings : General 9am - 6pm IST or 10am - 7pm IST Mandatory skills : Data engineering (4+years), Databricks (3.5+ years), Pyspark (3+ years), Python (preferred) or bash, Data pipeline,...


  • Bangalore/Remote, IN Apya Capital Services Pvt. Ltd. Full time

    Position Overview : As the Full Stack Senior Architect at Openbracket, you'll be instrumental in shaping the architecture and functionality of our platform. Collaborating closely with crossfunctional teams, you'll translate business requirements into scalable, efficient, and user-friendly solutions. We're looking for someone with exceptional...


  • remote, IN VAYUZ Technologies Full time

    Job Description : The Managed Services Senior iOS Developer will be responsible for building and maintaining internal and external facing mobile applications for Rightpoint's clients using native iOS frameworks and tools. In addition to being a strong contributor to the development effort, the Senior/Lead iOS Developer will help mentor and coach more...


  • Bangalore/Remote, IN Core Edge Solutions LLP Full time

    Job Description :We are looking to hire Cisco Sr Engineers for our US clients from India. The candidate must have strong skills in Cisco Catalyst, Nexus, ASR and networking skills.Position : Senior Cisco EngineerExperience : 8+yearsLocation : Bengaluru/RemoteRequired Skills : Strong Cisco expertise - Catalyst, Nexus, ASR.- Hands-on experience supporting...


  • Any Location/Remote, IN Prime Infosoft Full time

    Roles And Responsibilities : - Architect, build and integrate end-to-end life cycles of large-scale, distributed machine learning systems i.e. ML Ops using cutting-edge tools/frameworks. - Develop tools and services for explainability of ML solutions.- Implement distributed cloud GPU training approaches for deep learning models. - Build software/tools that...


  • Remote, IN Squareroot Consulting Pvt Ltd Full time

    We are looking for an experienced Java Developer to join our development team. If you have a passion for Java 8, Microservices, Spring Boot, RESTful API development, Reactive programming, AWS, Kafka, and NoSQL databases, we want to hear from you.Role : Principle Software EngineerExperience : 5+ Years Location : Complete Remote Key Responsibilities : -...

  • MLOps Engineer

    6 days ago


    Gurgaon/Gurugram/remote, IN SunKing Full time

    The team you would join :The Global Analytics and Technology function at Sun King helps us build technology enabled solutions based on data driven insights. We have a team of data scientists, data engineers, analysts, technical architects, android developers, web designers, backend engineers, product managers and UI/UX developers working on developing...


  • Remote, IN Prime Infosoft Full time

    Required Skills :- 5+ years of total experience in IT.- 4+ years of experience as an Engineer focused on 09- 3+ years of experience working with functional and automation testing- Hands-on Azure experience- Strong analytical and critical thinking skills- Ability to solve technical challenges in creative ways- Excellent spoken and written English...

  • Publicis Sapient

    3 weeks ago


    Noida/Bangalore/Delhi NCR/gurgaon,Permanent Remote, IN Publicis Sapient Full time

    We at Publicis Sapient, enable our clients to Thrive in Next and to create business value through expert strategies, customer-centric experience design, and world class product engineering. The future of business is disruptive; transformative; and becoming digital to the core.We seek the (Passionate Technologists) who are :- Deeply skilled, bold,...

  • RODOD Engineer

    3 weeks ago


    Bangalore/Remote, IN Optivalue tek consulting Full time

    Responsibilities :- Working Knowledge of all the RODOD products data migration components.- Well verse with BRM, Siebel Schemas- Design the Data model and Legacy data mapping- Design data conversion techniques and experience in handling the legacy data- Leading the North bound and South bound data integrations- Producing the Cutover Strategy, Cutover Plan &...

  • Java Tech Lead

    3 weeks ago


    Remote, IN Squareroot Consulting Pvt Ltd Full time

    Hiring for a Midsize US based SaaS Product Company for their Bangalore team.Role/Job Title: Java Tech Lead for Cloud Native PlatformLocation: Remote (WFH)Education: Any Engineering Graduate like We are seeking a talented and experienced Java Tech Lead to join our Cloud Native Platform team. Looking forward to someone who aspire to become Tech Architect over...


  • Bangalore/remote, IN Iitjobs.com Full time

    Job Description : Job location : 100% RemoteInterview mode : Face to Face (Bangalore) (8th May - 9th May 2024)Job type : Contract basisRelevant Experience : 5 plus years (total exp can go till 8-10 years but not beyond)Key Responsibilities :- Test Planning & Strategy : Develop test plans and collaborate with teams to define acceptance criteria.- Automation...

  • Salesforce Tester

    3 weeks ago


    Pune/remote, IN D-TechWorks Pvt. ltd Full time

    Exp : 4 to 5 yrsLocation : Pune hybrid/ REMOTE (In case of Remote candidate can be asked to visit the Pune office once in a month if required only)NP : Immediate to 10 daysJob Description : QA testing with experience on SFDC platform and data testingRequired Skills : QA testing, SFDC , data testingQuality assurance testers are primarily responsible for...

  • Full Stack Developer

    3 weeks ago


    Bangalore/Mumbai/Remote, IN Squareroot Consulting Pvt Ltd Full time

    Job Description :Looking for highly skilled and experienced Java Fullstack Developer with Angular & ReactJs with 2+ Years of experience for SaaS Fintech Company As a Full stack Developer, you will play a key role in designing, developing, and maintaining robust and scalable web applications. Your proficiency in Java, along with front-end frameworks like...

  • Python Developer

    3 weeks ago


    Anywhere in India/Multiple Locations/Remote, IN SGP R&D India Pvt Ltd Full time

    Job Description :DecisionPoint is aggressively integrating our homegrown portal with outside services. These services all use some form of REST API, either XML or JSON formatted. We are looking for an intermediate-level developer who can learn these APIs, create the necessary retrieval or webhook functionality, and store the results in a database.Role...