PhysicsWallah - Data Engineer - ETL

4 weeks ago


Bengaluru, India PhysicsWallah Full time

Working Experience :

- Minimum 1 year of work experience.

- Startup experience preferred, Streaming Platform, Edtech work experience bonus.

Roles & Responsibilities :

- Develop ETL (Extract, Transform, Load) processes to move and transform data between systems.

- Integrate data from various sources, ensuring consistency and accuracy.

- Monitor system performance and identify areas for optimization.

- Align architecture with business requirements and provide solutions which fit best to solve the business problems.

- Build the infrastructure required for optimal ETL pipelines from a wide variety of data sources using SQL and AWS big data technologies.

- Evaluate and recommend new technologies to enhance data processing capabilities.

- Work closely with data scientists, analysts, and other stakeholders to understand their data needs.

- Use programming language( python, spark) and tools efficiently to collate the data.

- Identify ways to improve data reliability, efficiency and quality.

- Use data to discover tasks that can be automated.

Skill Sets :

- Can Develop ETL (Extract, Transform, Load) processes to move and transform data between systems.

- Have good hands-on experience in any coding language Python or Scala.

- Good understanding of Data Engineering concepts such as data warehousing, datalakes, data modeling, data quality assurance, data lifecycle management, streaming data, metadata management etc.

- Strong hold on cloud-based ecosystems(AWS preferred).

- Have an understanding of data pipeline orchestration tools such as Airflow or Azkaban (Airflow Preferable).

- Can work with spark, EMR and Kubernetes cluster.

- Can write spark jobs, shell scripts and optimized data pipelines.

- Experience with relational SQL and NoSQL databases, including Postgres, Amazon Redshift and MongoDB.

- Have an understanding of OOPS-based data platforms, and can develop data platform modules.

- Good understanding of backend APIs and their use cases.

(ref:hirist.tech)

  • Bengaluru, India PhysicsWallah Full time

    Company Description : PhysicsWallah is an Indian online education technology startup based in Delhi, recently became 101st Unicorn of India, originally created as a YouTube channel in 2014 by Mr.Alakh Pandey. We are the first company aiming to build an affordable online education platform for each Indian student who dreams of IIT & AIIMS and other...


  • Bengaluru, India PhysicsWallah Full time

    About the job :Name of Profile : Data Scientist, SDE 2/3Location : Noida, BangaloreCTC & Perks : Remuneration : Other perks : Health Insurance, Accommodation policy, Food & Beverages, Shift allowance, and LeaveQualification & Eligibility :- Bachelor's or higher degree in a quantitative discipline (computer science, statistics, engineering, applied...

  • Big Data Mentor

    7 days ago


    Bengaluru, India PW (PhysicsWallah) Full time

    Company OverviewPhysicsWallah family has crossed over 6M+ students and is continuously raising its bar in the field of education, giving everything that students need with best-in-class faculty to support them in achieving their dreams. Observing the financial implications of many enrolling in expensive online courses, PhysicsWallah focuses on providing...

  • Business Analyst

    2 weeks ago


    Bengaluru, Karnataka, India PhysicsWallah Full time

    Company Description :PhysicsWallah is an Indian online education technology startup based in Delhi, recently became 101st Unicorn of India, originally created as a YouTube channel in 2014 by Mr.Alakh Pandey. We are the first company aiming to build an affordable online education platform for each Indian student who dreams of IIT & AIIMS and other categories,...

  • Data Scientist

    2 weeks ago


    Bengaluru, Karnataka, India PW (PhysicsWallah) Full time

    Data Science Job Opening at PhysicsWallah We are seeking a Data Scientist with 3 to 7 years of experience, particularly in startups and bonus points if you have Edtech background. The role is based in Noida & Bangalore for Work From Office. Roles & Responsibilities: Help teams understand the impact of Data Science and manage their expectations. Utilize...

  • Data Scientist

    2 weeks ago


    Bengaluru, Karnataka, India PW (PhysicsWallah) Full time

    Working Experience:3 to 7 YearsStartup experience preferred, Edtech work experience bonusLocation: Noida & Bangalore (WFO)Roles & Responsibilities:Help teams understand what Data Science can do for them and set the right expectations.Use deep learning, machine learning and analytical methods to create scalable solutions for business problems.Create...


  • Bengaluru, India ConsultBae Full time

    **Location**: Bangalore **Mode of Working**: 5 days WFO **Experience**:3+ Years **REQUIREMENTS**: - Strong proficiency with JavaScript or TypeScript. - Knowledge of Node.js and frameworks available for it.(such as EXPRESS, NestJS,etc) - Understanding the nature of asynchronous programming and its quirks and workarounds. - Good understanding of...


  • Bengaluru, Karnataka, India ConsultBae Full time

    Location: BangaloreMode of Working: 5 days WFOExperience: 2-4 YearsREQUIREMENTS: Strong proficiency with JavaScript or TypeScript. Knowledge of and frameworks available for it.(such as EXPRESS, NestJS,etc) Understanding the nature of asynchronous programming and its quirks and workarounds. Good understanding of serverside templating languages (such as...


  • Bengaluru, India PhysicsWallah Full time

    Job Description : Company Description : Physics Wallah is an Indian online education technology startup based in Delhi, originally created as a YouTube channel in 2014 by Mr. Alakh Pandey. We are the first company aiming to build an affordable online education platform for each Indian student who dreams of IIT & AIIMS but is unable to afford the existing...

  • Data Scientist

    4 weeks ago


    Bengaluru, India PW (PhysicsWallah) Full time

    Working Experience:3 to 7 YearsStartup experience preferred, Edtech work experience bonusLocation: Noida & Bangalore (WFO)Roles & Responsibilities:Help teams understand what Data Science can do for them and set the right expectations.Use deep learning, machine learning and analytical methods to create scalable solutions for business problems.Create...

  • Data Scientist

    4 weeks ago


    Bengaluru, India PW (PhysicsWallah) Full time

    Working Experience: 3 to 7 Years Startup experience preferred, Edtech work experience bonus Location: Noida & Bangalore (WFO) Roles & Responsibilities: Help teams understand what Data Science can do for them and set the right expectations. Use deep learning, machine learning and analytical methods to create scalable solutions for business problems....

  • Data Scientist

    4 weeks ago


    Bengaluru, India PW (PhysicsWallah) Full time

    Working Experience:3 to 7 YearsStartup experience preferred, Edtech work experience bonusLocation: Noida & Bangalore (WFO)Roles & Responsibilities:Help teams understand what Data Science can do for them and set the right expectations.Use deep learning, machine learning and analytical methods to create scalable solutions for business problems.Create...

  • Data Engineer

    4 weeks ago


    Bengaluru, India Mobile Programming LLC Full time

    Job Description :Position : Data EngineerExperience : 6+ yearsWork Mode : Work from OfficeLocation : BangaloreExperience in Nifi or Tibco is mandatory.Mandatory Skills : ETL, DevOps platform, Nifi or TibcoPlease note : This position is focused on development rather than migration. We are seeking an experienced Data Engineer to join our team. As a Data...


  • Bengaluru, India PhysicsWallah Full time

    Role : Backend Developer SDE 3 NodeJs. Location : Bangalore (WFO). Contract Duration : 6 months (can be extended on the basis of performance). Responsibilities :- Work closely with 2-4 engineers directly to drive development projects.- Work with EM and architects to develop solutions which are scalable and robust.- Mentor junior engineers in the team to...


  • Bengaluru, Karnataka, India ConsultBae Full time

    Location: BangaloreMode of Working: 5 days WFOExperience:3+ YearsREQUIREMENTS: Strong proficiency with JavaScript or TypeScript. Knowledge of and frameworks available for it.(such as EXPRESS, NestJS,etc) Understanding the nature of asynchronous programming and its quirks and workarounds. Good understanding of serverside templating languages (such as...


  • Bengaluru, India Antal International Full time

    Position Title: QA Engineer - DataAbout the team: You will be part of the Inscape QA team that is focused on quality on front end embedded client/TV as well as backend cloud services that reports high quality data to customers.The backend QA team is responsible to validate our award-winning Inscape data set which is used by millions of people every day. We...

  • QA Engineer

    4 days ago


    Bengaluru, India Antal International Full time

    Job DescriptionJob Title: QA Engineer - Data/ETLExperience Range: 7 - 12 yearsLocations: BangaloreNp: Immediate to 30 daysIndustry: IT service management companyWhat you Will do• Validates data and ETL pipelines to bring new data into a datawarehouse• Collaborate with cross-functional teams (Product/Data science/Dataengineering) to develop, execute, and...

  • Data Engineer

    1 week ago


    Bengaluru, India Hunarstreet Technologies Pvt Ltd Full time

    Job Description :- We are seeking a highly skilled Trainer with extensive experience in Data Engineering to join our team.- The ideal candidate will possess a robust background in developing data pipelines, ETL processes, and data warehousing solutions.- As a Trainer, you will be responsible for delivering comprehensive training sessions on data engineering...


  • Bengaluru, Karnataka, India SemperFi Solutions Full time

    Shift timings : 12pm to 9 PMTotal experience required : 15-20 years.Job Description : Lead and mentor a team of data engineers in designing, developing, and maintaining efficient and reliable ETL pipelines. Develop advanced scripts using Python for data extraction, transformation, and loading (ETL) processes. Architect robust ETL solutions to support diverse...

  • Data Engineer

    4 weeks ago


    Bengaluru, India CYBERSAPIENT TECHNOLOGIES PRIVATE LIMITED Full time

    Company Description : CST Cyber Sapient is a company dedicated to helping clients achieve advocacy through exceptional product and service experiences. We work closely with our clients to drive change within their organization and provide support in areas such as strategic vision, product innovation, user experience, talent support, and technical delivery....