Data Engineer, Rust

Edge & Node is at the forefront of web3 innovation. Our mission is to establish The Graph as the unbreakable foundation of open data. Our pioneering subgraphs set the industry standard and solidify The Graph as the premier solution for organizing and accessing blockchain data.

At Edge & Node, we champion a decentralized future based on shared values. Dedicated to decentralizing power and resisting censorship, we aim for a robust, permissionless information era free from central control, thus eliminating the traditional vulnerabilities associated with misplaced trust.

The Graph Network Engineering team is focused on building and maintaining core software components that make The Graph work. We are especially focused on graph-node, an Open Source Rust project that provides the core indexing capabilities of The Graph.

We are looking for a Data Engineer with deep understanding of relational databases and modern data stacks, and a desire to code in Rust. A Rust Data Engineer at E&N will not just use Rust data tools, but build our general purpose blockchain data systems and also contribute to our dependencies.

What You’ll Be Doing

• Working within the Graph Node team to improve Graph Node’s capabilities as a data processing and querying engine
• Familiarizing yourself with the large and complex Rust codebase that is Graph Node
• Using subgraphs to understand both the specification implemented by Graph Node as well as the developer experience of the builders who are our users.
• Develop an understanding of existing code and design choices, and then analyze how they can be experimented with and improved upon
• Setting up performance tests, doing quantitative assessments of any proposals and changes you make, and monitoring how the changes ultimately behave when rolled out
• Experimentally validating, and if necessary, falsifying your own ideas.
• Reviewing pull requests of your colleagues and taking responsibility for the reviewed code as if it were your own
• Documenting important aspects of the software while understanding that Graph Node has a large community of independent operators that need to understand how to run, configure, and monitor Graph Node

What We Expect

• You’ve contributed more than 10,000 lines of code to a production software product
• Thinking about data in SQL terms comes naturally for you
• You have an understanding of some of the theory behind data systems, such as relational algebra, and an understanding of fundamental DB data structures and data formats, such as BTrees, LSM Trees, and compression formats
• You have an interest in higher-level query languages such GraphQL
• You have an interest in federated data and federated query frameworks
• You understand how small design choices can have large effects in big data systems
• You are comfortable working with an existing system and codebase and making fundamental improvements to it while being mindful of backwards compatibility
• You understand tracing and debugging requirements of complex software
• You have an understanding of the academia and theory that backs the software libraries you use but also understand the pragmatic necessity of shipping usable software quickly

About the Graph

The Graph is the source of data and information for the decentralized internet. As the original decentralized data marketplace that introduced and standardized subgraphs, The Graph has become web3’s method of indexing and accessing blockchain data. Since its launch in 2018, tens of thousands of developers have built subgraphs for dapps across 50+ blockchains - including  Ethereum, Arbitrum, Optimism, Base, Polygon, Celo, Fantom, Gnosis, and Avalanche.

As demand for data in web3 continues to grow, The Graph enters a New Era with a more expansive vision including new data services and query languages, ensuring the decentralized protocol can serve any use case - now and into the future.

Discover more about how The Graph is shaping the future of decentralized physical infrastructure networks (DePIN) and stay connected with the community. Follow The Graph on X, LinkedIn, Instagram, Facebook, Reddit, and Medium. Join the community on The Graph’s Telegram, join technical discussions on The Graph’s Discord.

The Graph Foundation oversees The Graph Network. The Graph Foundation is overseen by the Technical Council. Edge & Node, StreamingFast, Semiotic Labs, The Guild, Messari, GraphOps, Pinax and Geo are eight of the many organizations within The Graph ecosystem.