Fivetran - Data Lake Architect (Oakland, CA)


Oakland, CA

Engineering

Full-time

Wherever you’re from, whatever your background, Fivetran needs you! At Fivetran, we believe that inclusion and diversity are key to our success. By fully leveraging our diverse experiences, backgrounds and insights, we inspire innovation, challenge the status quo and create better outcomes for our people and our customers. Making inclusion and diversity a competitive advantage is front and center for us.

Fivetran is looking for an experienced software architect to build out our next-generation data lake. Fivetran is a fully-managed data pipeline that pipes data from sources like Salesforce and Postgres into destinations like Snowflake and BigQuery. We follow a zero-configuration, automation-first approach. Our 500+ customers leave the pipes to us and focus on getting insights out of their data. We're looking for a senior technical architect to help us bring this automation-first approach to data lakes. Our customers should be able to pipe data from any Fivetran source into a Parquet-in-S3 data lake, so they have a vendor-neutral long term repository of their data. We're looking for domain expert to lead a small team defining and building out this vision.

As a Data Lake Architect at Fivetran you will:

    • Create a new source connector within the first 1 month
    • Start building a prototype Parquet-in-{S3,GCS} data lake in month 2
    • Develop general awareness of all areas of Fivetran's code base and infrastructure by month 6
    • Start participating in our on-call rotation by month 3
    • Start contributing to hiring by participating in the interview process by month 2
    • Launch a Parquet-in-{S3,GCS} data lake alpha with < 5 customers by month 6
    • Launch the data lake to general availability by month 12

About you:

    • Writes well-structured and performant code
    • Expertise in Parquet format, distributed computing, Hadoop ecosystem
    • Works well in a small team
    • Mentors junior developers
    • Passionate about performance optimization
    • Experience with VisualVM or other profilers
    • Strong ability to communicate about software architecture and related decision making

Perks of working with us:

    • 100% paid Medical, Dental, Vision and Basic Life Insurance
    • Unlimited/flexible PTO
    • 401k match program
    • Pet Insurance -- and yes, you can bring your well-behaved fur babies to work
    • Commuter Benefits to help with transit and parking costs
    • Professional development and training opportunities
    • Unlimited coffee, office snacks and frequent catered lunches
    • Company happy hours and fun team building activities