Cloudflare HTTP Logs

Cloudflare HTTP logs provide detailed information about HTTP and HTTPS requests passing through Cloudflare’s reverse proxy and content delivery network (CDN). These logs capture data such as client IPs, request URLs, response status codes, caching status, request method (GET, POST, etc.), and performance metrics like latency. They are useful for monitoring web traffic, troubleshooting website performance, detecting security threats such as DDoS attacks, and optimizing content delivery.

Ingest Methods

Setup the ingestion of this source using one of the following guides.

If using an AWS S3 bucket use the following SNS topic ARN to send your bucket notifications.

arn:aws:sns:<REGION>:253602268883:runreveal_cloudflarehttp

Setup

Setting up Cloudflare HTTP logs requires the use of Cloudflare Logpush.

Navigate to the Logpush setup page in your Cloudflare account and create a new logpush job that sends your HTTP logs to your storage bucket.

Once created Cloudflare will begin to push logs to your bucket and RunReveal will start to ingest them.

Schema

The following columns are exposed for this source. RunReveal applies schema normalization across all sources, ensuring uniform field names and data types for cross-source queries and reusable detection logic.

Table: cf_http_logs (57 columns)

ColumnType
workspaceIDString
sourceIDString
sourceTypeLowCardinality(String)
sourceTTLUInt32
receivedAtDateTime
idString
eventTimeDateTime
eventNameString
eventIDString
srcIPString
srcASCountryCodeString
srcASNumberUInt32
srcASOrganizationString
srcCityString
srcConnectionTypeString
srcISPString
srcLatitudeFloat64
srcLongitudeFloat64
srcUserTypeString
dstIPString
dstASCountryCodeString
dstASNumberUInt32
dstASOrganizationString
dstCityString
dstConnectionTypeString
dstISPString
dstLatitudeFloat64
dstLongitudeFloat64
dstUserTypeString
ColumnType
actorMap(String, String)
tagsMap(String, String)
resourcesArray(String)
serviceNameString
readOnlyBool
rawLogString
clientIPString
clientRequestHostString
clientRequestMethodString
clientRequestURIString
edgeEndTimestampDateTime
edgeResponseBytesUInt64
edgeResponseStatusUInt64
edgeResponseTimestampDateTime
rayIDString
securityActionString
securityRuleIDString
securityRuleDescriptionString
parentRayIDString
clientASNString
clientCountryString
clientDeviceTypeString
clientRegionCodeString
cacheCacheStatusString
clientRequestUserAgentString
originResponseDurationMsString
originResponseStatusString
cookiesMap(String, String)