![PhysicsWallah](https://media.trabajo.org/img/noimg.jpg)
PhysicsWallah - Data Engineer - ETL
4 weeks ago
Working Experience :
- Minimum 1 year of work experience.
- Startup experience preferred, Streaming Platform, Edtech work experience bonus.
Roles & Responsibilities :
- Develop ETL (Extract, Transform, Load) processes to move and transform data between systems.
- Integrate data from various sources, ensuring consistency and accuracy.
- Monitor system performance and identify areas for optimization.
- Align architecture with business requirements and provide solutions which fit best to solve the business problems.
- Build the infrastructure required for optimal ETL pipelines from a wide variety of data sources using SQL and AWS big data technologies.
- Evaluate and recommend new technologies to enhance data processing capabilities.
- Work closely with data scientists, analysts, and other stakeholders to understand their data needs.
- Use programming language( python, spark) and tools efficiently to collate the data.
- Identify ways to improve data reliability, efficiency and quality.
- Use data to discover tasks that can be automated.
Skill Sets :
- Can Develop ETL (Extract, Transform, Load) processes to move and transform data between systems.
- Have good hands-on experience in any coding language Python or Scala.
- Good understanding of Data Engineering concepts such as data warehousing, datalakes, data modeling, data quality assurance, data lifecycle management, streaming data, metadata management etc.
- Strong hold on cloud-based ecosystems(AWS preferred).
- Have an understanding of data pipeline orchestration tools such as Airflow or Azkaban (Airflow Preferable).
- Can work with spark, EMR and Kubernetes cluster.
- Can write spark jobs, shell scripts and optimized data pipelines.
- Experience with relational SQL and NoSQL databases, including Postgres, Amazon Redshift and MongoDB.
- Have an understanding of OOPS-based data platforms, and can develop data platform modules.
- Good understanding of backend APIs and their use cases.
-
PhysicsWallah - Business Analyst
4 weeks ago
Bengaluru, India PhysicsWallah Full timeCompany Description : PhysicsWallah is an Indian online education technology startup based in Delhi, recently became 101st Unicorn of India, originally created as a YouTube channel in 2014 by Mr.Alakh Pandey. We are the first company aiming to build an affordable online education platform for each Indian student who dreams of IIT & AIIMS and other...
-
Bengaluru, India PhysicsWallah Full timeAbout the job :Name of Profile : Data Scientist, SDE 2/3Location : Noida, BangaloreCTC & Perks : Remuneration : Other perks : Health Insurance, Accommodation policy, Food & Beverages, Shift allowance, and LeaveQualification & Eligibility :- Bachelor's or higher degree in a quantitative discipline (computer science, statistics, engineering, applied...
-
Big Data Mentor
7 days ago
Bengaluru, India PW (PhysicsWallah) Full timeCompany OverviewPhysicsWallah family has crossed over 6M+ students and is continuously raising its bar in the field of education, giving everything that students need with best-in-class faculty to support them in achieving their dreams. Observing the financial implications of many enrolling in expensive online courses, PhysicsWallah focuses on providing...
-
Business Analyst
2 weeks ago
Bengaluru, Karnataka, India PhysicsWallah Full timeCompany Description :PhysicsWallah is an Indian online education technology startup based in Delhi, recently became 101st Unicorn of India, originally created as a YouTube channel in 2014 by Mr.Alakh Pandey. We are the first company aiming to build an affordable online education platform for each Indian student who dreams of IIT & AIIMS and other categories,...
-
Data Scientist
2 weeks ago
Bengaluru, Karnataka, India PW (PhysicsWallah) Full timeData Science Job Opening at PhysicsWallah We are seeking a Data Scientist with 3 to 7 years of experience, particularly in startups and bonus points if you have Edtech background. The role is based in Noida & Bangalore for Work From Office. Roles & Responsibilities: Help teams understand the impact of Data Science and manage their expectations. Utilize...
-
Data Scientist
2 weeks ago
Bengaluru, Karnataka, India PW (PhysicsWallah) Full timeWorking Experience:3 to 7 YearsStartup experience preferred, Edtech work experience bonusLocation: Noida & Bangalore (WFO)Roles & Responsibilities:Help teams understand what Data Science can do for them and set the right expectations.Use deep learning, machine learning and analytical methods to create scalable solutions for business problems.Create...
-
Physicswallah - Backend Sde 2/3
4 weeks ago
Bengaluru, India ConsultBae Full time**Location**: Bangalore **Mode of Working**: 5 days WFO **Experience**:3+ Years **REQUIREMENTS**: - Strong proficiency with JavaScript or TypeScript. - Knowledge of Node.js and frameworks available for it.(such as EXPRESS, NestJS,etc) - Understanding the nature of asynchronous programming and its quirks and workarounds. - Good understanding of...
-
Physicswallah - Backend Sde 2
2 weeks ago
Bengaluru, Karnataka, India ConsultBae Full timeLocation: BangaloreMode of Working: 5 days WFOExperience: 2-4 YearsREQUIREMENTS: Strong proficiency with JavaScript or TypeScript. Knowledge of and frameworks available for it.(such as EXPRESS, NestJS,etc) Understanding the nature of asynchronous programming and its quirks and workarounds. Good understanding of serverside templating languages (such as...
-
Bengaluru, India PhysicsWallah Full timeJob Description : Company Description : Physics Wallah is an Indian online education technology startup based in Delhi, originally created as a YouTube channel in 2014 by Mr. Alakh Pandey. We are the first company aiming to build an affordable online education platform for each Indian student who dreams of IIT & AIIMS but is unable to afford the existing...
-
Data Scientist
4 weeks ago
Bengaluru, India PW (PhysicsWallah) Full timeWorking Experience:3 to 7 YearsStartup experience preferred, Edtech work experience bonusLocation: Noida & Bangalore (WFO)Roles & Responsibilities:Help teams understand what Data Science can do for them and set the right expectations.Use deep learning, machine learning and analytical methods to create scalable solutions for business problems.Create...
-
Data Scientist
4 weeks ago
Bengaluru, India PW (PhysicsWallah) Full timeWorking Experience: 3 to 7 Years Startup experience preferred, Edtech work experience bonus Location: Noida & Bangalore (WFO) Roles & Responsibilities: Help teams understand what Data Science can do for them and set the right expectations. Use deep learning, machine learning and analytical methods to create scalable solutions for business problems....
-
Data Scientist
4 weeks ago
Bengaluru, India PW (PhysicsWallah) Full timeWorking Experience:3 to 7 YearsStartup experience preferred, Edtech work experience bonusLocation: Noida & Bangalore (WFO)Roles & Responsibilities:Help teams understand what Data Science can do for them and set the right expectations.Use deep learning, machine learning and analytical methods to create scalable solutions for business problems.Create...
-
Data Engineer
4 weeks ago
Bengaluru, India Mobile Programming LLC Full timeJob Description :Position : Data EngineerExperience : 6+ yearsWork Mode : Work from OfficeLocation : BangaloreExperience in Nifi or Tibco is mandatory.Mandatory Skills : ETL, DevOps platform, Nifi or TibcoPlease note : This position is focused on development rather than migration. We are seeking an experienced Data Engineer to join our team. As a Data...
-
PhysicsWallah - Backend Developer - Node.js
4 weeks ago
Bengaluru, India PhysicsWallah Full timeRole : Backend Developer SDE 3 NodeJs. Location : Bangalore (WFO). Contract Duration : 6 months (can be extended on the basis of performance). Responsibilities :- Work closely with 2-4 engineers directly to drive development projects.- Work with EM and architects to develop solutions which are scalable and robust.- Mentor junior engineers in the team to...
-
Physicswallah - Backend Sde 2/3
2 weeks ago
Bengaluru, Karnataka, India ConsultBae Full timeLocation: BangaloreMode of Working: 5 days WFOExperience:3+ YearsREQUIREMENTS: Strong proficiency with JavaScript or TypeScript. Knowledge of and frameworks available for it.(such as EXPRESS, NestJS,etc) Understanding the nature of asynchronous programming and its quirks and workarounds. Good understanding of serverside templating languages (such as...
-
QA Engineer ETL/Data
3 days ago
Bengaluru, India Antal International Full timePosition Title: QA Engineer - DataAbout the team: You will be part of the Inscape QA team that is focused on quality on front end embedded client/TV as well as backend cloud services that reports high quality data to customers.The backend QA team is responsible to validate our award-winning Inscape data set which is used by millions of people every day. We...
-
QA Engineer
4 days ago
Bengaluru, India Antal International Full timeJob DescriptionJob Title: QA Engineer - Data/ETLExperience Range: 7 - 12 yearsLocations: BangaloreNp: Immediate to 30 daysIndustry: IT service management companyWhat you Will do• Validates data and ETL pipelines to bring new data into a datawarehouse• Collaborate with cross-functional teams (Product/Data science/Dataengineering) to develop, execute, and...
-
Data Engineer
1 week ago
Bengaluru, India Hunarstreet Technologies Pvt Ltd Full timeJob Description :- We are seeking a highly skilled Trainer with extensive experience in Data Engineering to join our team.- The ideal candidate will possess a robust background in developing data pipelines, ETL processes, and data warehousing solutions.- As a Trainer, you will be responsible for delivering comprehensive training sessions on data engineering...
-
ETL/Data Engineering Manager
2 weeks ago
Bengaluru, Karnataka, India SemperFi Solutions Full timeShift timings : 12pm to 9 PMTotal experience required : 15-20 years.Job Description : Lead and mentor a team of data engineers in designing, developing, and maintaining efficient and reliable ETL pipelines. Develop advanced scripts using Python for data extraction, transformation, and loading (ETL) processes. Architect robust ETL solutions to support diverse...
-
Data Engineer
4 weeks ago
Bengaluru, India CYBERSAPIENT TECHNOLOGIES PRIVATE LIMITED Full timeCompany Description : CST Cyber Sapient is a company dedicated to helping clients achieve advocacy through exceptional product and service experiences. We work closely with our clients to drive change within their organization and provide support in areas such as strategic vision, product innovation, user experience, talent support, and technical delivery....