Remote - Senior Data Engineer
Company: Shopify
Location: Miami
Posted on: May 16, 2022
Job Description:
Job DescriptionOur -Data Engineering group -builds -and
maintains -the platform that delivers accessible data to power
decision-making at Shopify for millions of merchants. We're hiring
high-impact developers across teams:
- The Engine group organizes all merchant and Shopify data into
our data lake in highly-optimized formats for fast query
processing, and maintaining the security + -quality of our
datasets.
- The Analytics group builds products that leverage the Engine
primitives to deliver simple and useful products that power
scalable transformation of data at Shopify in batch, or streaming,
or for machine learning. This group is focused on making it really
simple for our users to answer three questions: What happened in
the past? What is happening now? And, what will happen in the
future? - -
- The Data Experiences group builds end-user experiences for
experimentation, data discovery, and business intelligence
reporting.
- The Reliability group operates the data platform efficiently in
a consistent and reliable manner. They build tools for other teams
at Data Platform to leverage to encourage consistency and they
champion reliability across the platform.QualificationsWhile our
-teams value -specialized skills, they've also got a lot in common.
We're looking for a(n): -
- High-energy self-starter with experience and passion for data
and big data scale processing. You enjoy working in fast-paced
environments and love making an impact. -
- Exceptional communicator with -the -ability to translate
technical concepts into easy to understand language for our
stakeholders. -
- Excitement for working with a remote team; you value
collaborating on problems, asking questions, delivering feedback,
and supporting others in their goals whether they are in your
vicinity or entire cities apart.
- Solid software engineer: experienced in building and
maintaining systems at scale.A Senior Data Developer at Shopify
typically has -4-6 years of experience in one or more of the
following areas:
- Working with the internals of a distributed compute engine
(Spark, Presto, DBT, or Flink/Beam)
- Query optimization, resource allocation and management, and
data lake performance (Presto, SQL)
- Cloud infrastructure (Google Cloud, Kubernetes, Terraform)
- Security products and methods (Apache Ranger, Apache Knox,
OAuth, IAM, Kerberos)
- Deploying and scaling ML solutions using open-source frameworks
(MLFlow, TFX, H2O, etc.)
- Building full-stack applications (Ruby/Rails, React,
TypeScript)
- Background and practical experience in statistics and/or
computational mathematics (Bayesian and Frequentist approaches,
NumPy, PyMC3, etc.)
- Modern Big-Data storage technologies (Iceberg, Hudi,
Delta)#Senior Software Developer- Distributed Systems #Senior
Software Developer- Data Engineering #Senior Data App Developer
#Senior Data Reliability Engineer #Senior Software Developer-
ReliabilityAdditional InformationAs there are multiple positions,
this posting will remain live until all positions have been filled.
Successful candidates can expect to hear back from us within 2
weeks of application.#LI-REMOTE -Our belief is that a strong
commitment to diversity & inclusion enables us to truly make
commerce better for everyone. We encourage applications from
Indigenous peoples, racialized people, people with disabilities,
people from gender and sexually diverse communities, and/or people
with intersectional identities. Please take a look at to learn more
about Shopify's commitments to our communities, and our planet.At
Shopify, we understand that experience comes in many forms. We're
dedicated to adding new perspectives to the team - so if your
experience is this close to what we're looking for, please consider
applying.PandoLogic. Keywords: Data Engineer, Location: Miami, FL -
33134
Keywords: Shopify, Miami , Remote - Senior Data Engineer, Engineering , Miami, Florida
Didn't find what you're looking for? Search again!
Loading more jobs...