Senior Data Engineer

2 months ago


Chennai, India Poshmark Full time

Job Description:


The Big Data team is a central player in the Poshmark organization. Our mission is to build a world-class big data platform to bring value out of data for us and for our customers. Our goal is to democratize data, support exploding business, provide reporting and analytics self-service tools, and fuel existing and new business critical initiatives.


The Data Engineering team at Poshmark is looking for an experienced software engineer to scale Datalake, ensuring real-time access to quality data for all the stakeholders. The role provides opportunity to showcase in-depth software development skills to build and maintain real-time and batch data pipelines with a focus on scalability and optimizations while collaborating with Data Science, Analytics, and Platform Engineering teams to build tools to access petabyte scale data.


Responsibilities

  • Build highly scalable, available, fault-tolerant data processing systems using AWS technologies, MapReduce, Hive, Kafka, Spark, Flink and other big data technologies to handle batch and real-time data processing over 10s of terabytes of data ingested every day and a petabyte-sized data warehouse.
  • Responsible for taking care of some of the most critical data pipelines at Poshmark.
  • Participate in architecture discussions, influence product roadmap, build best practices, take ownership and responsibility over new projects.
  • Create WBS (Work breakdown structure) for projects and execute them, taking full ownership, with minimal guidance.


Desired Skills & Experience

  • 3+ years of relevant software engineering experience.
  • 1+ year of Data Engineering experience.
  • Excellent technical problem solving using data structures and algorithms, with emphasis on optimization and code quality.
  • Expertise in architecting and building large-scale data processing systems using Big Data technologies like Hadoop, Hbase, Spark, Kafka, Druid, Flink, DataLake etc.
  • Eagerness to try out newer technologies and adopt them as and when needed.
  • Object Oriented Patterns, Scala / Java / Python / C++ / SQL / Apache Spark, Hadoop, AWS S3, Redshift / Postgresql, Kinesis, EMR, Apache Airflow, Jenkins.



We built Poshmark around four core values:

Focus on people to create empowered communities that drive success.

Together we grow to support each other to strive for our dreams.

Lead with love to foster genuine connections built upon a foundation of respect.

Embrace your weirdness to accept and empower one another on their own unique journey. We’re invested in our team and community, working together to build an entirely new way to shop. That way, when we win, we all win together. Come help us build the most connected shopping experience ever.


About Us


Poshmark is a leading fashion resale marketplace powered by a vibrant, highly engaged community of buyers and sellers and real-time social experiences. Designed to make online selling fun, more social and easier than ever, Poshmark empowers its sellers to turn their closet into a thriving business and share their style with the world. Since its founding in 2011, Poshmark has grown its community to over 130 million users and generated over $10 billion in GMV, helping sellers realize billions in earnings, delighting buyers with deals and one-of-a-kind items, and building a more sustainable future for fashion. For more information, please visit www.poshmark.com, and for company news, visit newsroom.poshmark.com.


Why Poshmark?


At Poshmark, we’re constantly challenging the status quo and are looking for innovative and passionate people to help shape the future of Poshmark. We’re disrupting the industry by combining social connections with e-commerce through data-driven solutions and the latest technology to optimize our platform. We’re nothing without our amazing team who deliver an unparalleled social shopping experience to the millions of people we connect each day.


We built Poshmark around four core values: 1) focus on people to create empowered communities that drive success; 2) together we grow to support each other to strive for our dreams; 3) lead with love to foster genuine connections built upon a foundation of respect; and 4) embrace your weirdness to accept and empower one another on their own unique journey. We’re invested in our team and community, working together to build an entirely new way to shop. That way, when we win, we all win together. Come help us build the most connected shopping experience ever. We will set you up with comprehensive global and in-country benefits to support you and your family needs.


Poshmark is an Equal Opportunity Employer. We celebrate diversity and are committed to creating an inclusive environment for all employees.


View Poshmark's Job Applicant Privacy Policy here.


  • Senior Data Engineer

    4 months ago


    Chennai, India Saaki Argus & Averil Consulting Full time

    Hiring Senior Data Engineer for an IT Product Company Location : Chennai / Pune Role: Senior Data Engineer: Minimum 4+Yrs of Relevant Experience Mandatory Skills: Strong expertise in Python ( Class methods), OOPS in Python, SQL , Databricks , AWS or Azure cloud Master's degree in either software engineering, data engineering, data science, computer...

  • Senior Data Engineer

    11 hours ago


    chennai, India Zuci Systems Full time

    Job Title: Senior Data EngineerResponsibilities: As a Senior Data Engineer, you will be working with data architects to take data throughout its lifecycle - acquisition, exploration, data cleaning, integration, analysis, and visualization. You will be creating the pipeline for data processing, data visualization, and analytics products. You will be the go-to...

  • Senior Data Engineer

    1 month ago


    Chennai, India Zuci Systems Full time

    Job Title: Senior Data EngineerResponsibilities: As a Senior Data Engineer, you will be working with data architects to take data throughout its lifecycle - acquisition, exploration, data cleaning, integration, analysis, and visualization. You will be creating the pipeline for data processing, data visualization, and analytics products. You will be the go-to...

  • Senior Data Engineer

    1 month ago


    Chennai, India Zuci Systems Full time

    Job Title: Senior Data EngineerResponsibilities: As a Senior Data Engineer, you will be working with data architects to take data throughout its lifecycle - acquisition, exploration, data cleaning, integration, analysis, and visualization. You will be creating the pipeline for data processing, data visualization, and analytics products. You will be the go-to...

  • Senior Data Engineer

    1 month ago


    Chennai, India Zuci Systems Full time

    Job Title: Senior Data Engineer Responsibilities: As a Senior Data Engineer, you will be working with data architects to take data throughout its lifecycle - acquisition, exploration, data cleaning, integration, analysis, and visualization. You will be creating the pipeline for data processing, data visualization, and analytics products. You will be the...


  • Chennai, India Wavicle Data Solutions Full time

    Job descriptionWavicle Data Solutions is seeking an experienced and visionaryDirector of Data Engineeringto lead and manage our growing Data Engineering team.As a Director, you will be responsible for driving the technical strategy, overseeing complex data projects, and delivering high-quality solutions that support our clients' business goals. This role...

  • Senior Data Engineer

    1 month ago


    Chennai, India KANINI Full time

    Senior Data EngineerJob Overview:We are seeking a highly skilled Senior Data Engineer with 6-10 years of experience to lead and manage our data-driven projects. The ideal candidate should have a strong background in SQL, PySpark, AWS, Databricks, and Scala, with proven expertise in migration projects and Jira. This role requires excellent communication...


  • Chennai, India Wavicle Data Solutions Full time

    Job descriptionWavicle Data Solutions is seeking an experienced and visionary Director of Data Engineering to lead and manage our growing Data Engineering team.As a Director, you will be responsible for driving the technical strategy, overseeing complex data projects, and delivering high-quality solutions that support our clients' business goals. This role...


  • Chennai, India Wavicle Data Solutions Full time

    Job descriptionWavicle Data Solutions is seeking an experienced and visionary Director of Data Engineering to lead and manage our growing Data Engineering team.As a Director, you will be responsible for driving the technical strategy, overseeing complex data projects, and delivering high-quality solutions that support our clients' business goals. This role...


  • chennai, India Wavicle Data Solutions Full time

    Job descriptionWavicle Data Solutions is seeking an experienced and visionary Director of Data Engineering to lead and manage our growing Data Engineering team.As a Director, you will be responsible for driving the technical strategy, overseeing complex data projects, and delivering high-quality solutions that support our clients' business goals. This role...


  • chennai, India Wavicle Data Solutions Full time

    Job description Wavicle Data Solutions is seeking an experienced and visionary Director of Data Engineering to lead and manage our growing Data Engineering team. As a Director, you will be responsible for driving the technical strategy, overseeing complex data projects, and delivering high-quality solutions that support our clients' business goals. This...

  • Senior Data Engineer

    4 months ago


    Chennai, India Epam Full time

    Description EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that...

  • Senior Data Engineer

    3 months ago


    chennai, India PPLABILITY (OPC) PRIVATE LIMITED Full time

    Job Title: Senior Data Engineer-Data Modeling. Location: Bengaluru, Chennai, about the role? What your typical day would look like? As a Senior Data Engineer, you will work to solve some of the organizational data management problems that would enable them as a data-driven organization; Seamlessly switch between roles of an Individual Contributor, team...

  • Senior Data Engineer

    2 months ago


    Chennai, India Ciklum Full time

    Description Ciklum  is looking for a Senior Data Engineer  to join our team full-time in India. We are a custom product engineering company that supports both multinational organizations and scaling startups to solve their most complex business challenges. With a global team of over 4,000 highly skilled developers, consultants, analysts and...

  • Senior Data Engineer

    3 weeks ago


    chennai, India Truelancer.com Full time

    Job Title: Sr Data EngineerExperience: 5 - 9 yrsLocation: Work from Office ,ChennaiMandatory Skills: AWS Data Services+Strong in SQL QueriesAs a Senior Data Engineer, you will play a crucial role in designing, developing, and maintaining data pipelines and analytics solutions. You will work with a range of AWS technologies and data tools to ensure our...

  • Senior Data Engineer

    2 weeks ago


    Chennai, India Programming.com Full time

    Job DescriptionJob Title: Senior Data EngineerLocation : ChennaiSalary : ₹13 LPAExperience Required : 6 YearsNotice Period : Immediate to 15 daysResponsibilities :♦ Design and optimize data processing systems.♦ Collaborate with teams to implement data models.♦ Ensure data architecture aligns with business needs.♦ Build and maintain data...

  • Senior Consultant

    4 months ago


    chennai, India AstraZeneca Full time

    Job Title: Senior Consultant - Data Engineer Career Level - D3 Introduction to role: Join our Commercial IT Data Analytics & AI (DAAI) team as a Senior Consultant - Data Engineer. In this role, you will be responsible for developing, testing, and maintaining a scalable data product. You will have the opportunity to work with Databricks, PySpark,...

  • Senior Consultant

    4 months ago


    Chennai, India AstraZeneca Full time

    Job Title: Senior Consultant - Data Engineer Career Level - D3 Introduction to role: Join our Commercial IT Data Analytics & AI (DAAI) team as a Senior Consultant - Data Engineer. In this role, you will be responsible for developing, testing, and maintaining a scalable data product. You will have the opportunity to work with Databricks, PySpark, and...

  • Senior Consultant

    3 days ago


    chennai, India AstraZeneca Full time

    Job Title: Senior Consultant - Data Engineer Career Level - D3 Introduction to role: Join our Commercial IT Data Analytics & AI (DAAI) team as a Senior Consultant - Data Engineer. In this role, you will be responsible for developing, testing, and maintaining a scalable data product. You will have the opportunity to work with Databricks, PySpark, and...

  • Senior Data Engineer

    1 month ago


    Chennai, India KANINI Full time

    Senior Data Engineer Job Overview:We are seeking a highly skilled Senior Data Engineer with 6-10 years of experience to lead and manage our data-driven projects. The ideal candidate should have a strong background in SQL, PySpark, AWS, Databricks, and Scala, with proven expertise in migration projects and Jira. This role requires excellent communication...