Data Wrangler Solutions logoData Wrangler Get in touch
Petroleum data management platform

Your well data is scattered across fourteen spreadsheets

Data Wrangler rounds it up, reads what it can, loads what it can prove into SQL Server, and holds the rest with a reason. No more archaeology every time someone asks for a well.

Density map of more than three million wells across the United States, coloured by operator
Coloured by operator. The Permian is showing off again.
3.1 million wells.
Yes, all of them. On one map.
0
agency well headers
in the reference master
0
Wyoming leases,
federal and state
0
file formats read,
from LAS to Word
0
wild guesses loaded
(we checked)
Chapter one

Two gates into the corral

Tables come in through one gate, documents through the other. Both end up in the same documented model, and both remember where every row came from.

The drive from the partner

That external drive in the drawer is worth opening

Farm-ins, acquisitions and vendors hand over data the same way: a 2 TB external drive, a folder tree nobody designed, logs, reports, spreadsheets and seismic in whatever state they left the building.

Point Data Wrangler at the drive. It catalogs every file, reads what it can, and loads the result into the same database as your own wells, so the partner's data is searchable and on the map beside yours. Existing rows are not overwritten, and every row still names the file it came from, so you always know whose is whose.

It arrived in 2019. Nobody has opened it since. Until now.
Bulk Tabular Loader page with a folder path entered
Click to enlarge
Spreadsheets

Point it at a folder, not a file

The tabular loader scans a folder of CSV and Excel files, works out what each one is, and takes the lot through staging, column matching, foreign keys, load and verify.

A partner's delivery goes in as a delivery. If it was the wrong one, the run comes back out in one step.

Even the one called final_FINAL_v3.xlsx.
Column matching grid pairing source headers with database columns
Click to enlarge
Column matching

It matches the easy ones and asks about the rest

Exact matches go straight through; only the exceptions need you. A value that must point at something real, an operator for instance, is resolved rather than stored as loose text.

Skip a column on purpose and the record keeps that decision, so nobody later wonders where it went.

Skip is a decision. The record keeps it.
File Catalog and Workbench pipeline settings
Click to enlarge
Logs & documents

Your filing cabinet, promoted to database

The catalog walks a folder tree, works out what each file is, extracts what it says and stages the rows for promotion. LAS, DLIS, PDF, SEG-Y, shapefiles and Office documents all become records against the same wells.

We use OCR to read PDFs that are scanned images. Every row records the file it came from.

Documents are data. Most tools treat them as attachments.
Bar chart of each table's rows split between structured loads and documents
Click to enlarge
What documents add

The data you'd never get from spreadsheets alone

Each bar splits a table's rows by where they came from: structured files in blue, documents in orange. Casing, stimulations, drill-stem tests, core photos, petrophysical zones and shows arrive entirely from reports and logs.

Load only the spreadsheets and those tables stay empty. And because every row carries the file it came from, the split is proved, not estimated.

The orange is everything the spreadsheets never told you.
Wrong is worse than missing.

A confident wrong value plots, exports and gets quoted in a meeting. Usually yours. A missing one is at least honest about it.

Chapter two

Every file ends up on one of four posters

"Did it load?" has four honest answers, and each needs a different repair. So they are never squashed into a percentage.

WANTED
Loaded

Rows in the database carrying this file's id. Traceable back to the page they came from.

REWARD: a map you can trust
WANTED
Staged

Extracted and waiting in staging for the next promote. Nothing lost, nothing asserted.

LAST SEEN: in the waiting room
WANTED
Held

Blocked for a named reason: no well identifier, no location, an unregistered code. It waits and tells you which.

TAKE ALIVE. Held is recoverable.
WANTED
Nothing

Neither staged nor loaded. The only real failure, and the only one worth losing sleep over.

THE ACTUAL OUTLAW
Validation checks table with severities
Click to enlarge
Data quality

Checked on the way in, and again later

Required values, types, widths, constraints and duplicate keys, then business rules with a severity: a latitude out of range, a completion dated before the spud.

The same rules run over the database as it stands. A table no rule covers is reported as unexamined, which is a different answer from clean.

Chapter three

Everything hangs off the well

The fourteen-character identifier is the spine. It is the key in thirty-five tables, and it is how a log, a formation top and a production volume find each other.

Well popup on the map with production totals
Click to enlarge
From a dot on a map to the file it came from.
Scout ticket report with tops, casing and completion
Click to enlarge
Assembled from six tables. Printed as one page.
Chapter four

Lease & Land

24,178 Wyoming leases, federal and state, on the same map as the wells, each with its operator, status, dates, royalty and mineral type.

Leases around Casper coloured by effective decade
Click to enlarge
A century in colour

Sorted by decade, not by shoebox

Colour leases by owner, status, decade, size or elevation. Shaded by decade, the pattern around Casper is the history of where the activity went.

A single lease tract with wetlands showing through
Click to enlarge
One tract

The land man never has just the one question

Filter by county, status, operator, acreage, elevation, miles from a named town or highway, or how much of the tract is wetland.

A compound question, asked of one map instead of three systems.
Chapter five

Ask in English. Read the SQL before it runs.

Claude writes the query against the tables this database actually has. When it gets creative and names one that doesn't exist, the page flags it before anything runs. Then follow the results all the way to the file.

No walled garden.
It's your database.

A documented model in SQL Server. Query anything, export what you need, and keep the keys to your own ranch.

Intermission

Watch it run

Three million wells down to one, and back out to a spreadsheet. Recorded against a live database: nothing mocked, nothing sped up.

About eight minutes. Popcorn optional; coffee recommended.

Ready when you are

Ready to round up some wells?

Bring a messy folder. We'll show you what loads, what's held and why, on your own data.