Data source errors (feed diagnostics)

This article describes the typical process of diagnosing errors in a data source URL inserted into Confect.

The main thing to note is, that Confect only supports product feeds for eCommerce. Any type of feed formatted for Real Estate, Vehicles, Destinations etc. is not yet supported.

Check the status

You can always check the status of a feed by going into Settings > Data Sources.

Should a feed have an error, a more detailed explanation can be found below the source table. A failing feed will have a dropdown you can click to expand, and the description of the error will be displayed. The possible error types and their course of action are listed below.

Error types

Download error

The data source cannot be downloaded. Try opening the URL in your browser; it will probably fail. This is usually because the URL is wrong or the access to the feed is being blocked.

This can usually be fixed by setting the sharing, or access, settings (depending on the software) to allow reading/ viewing access.

Password-protected feed

If your data source is protected with a username and password, you will need to provide these details to the Confect software so it can be downloaded.

The login credentials need to be included in the URL with this format: https://username:password@URL

For example, if your username is "admin", the password is "12345", and your data source URL is "https://shopproducts.xml", you should insert the URL as such:

https://admin:[email protected]

Format error

The data source can be read but is in the wrong format.

Refer to the Data source requirements article.

Empty error

The data source works but is completely empty. This can happen if the user uses scraping or other unusual methods to collect the information. In this case, only the user can fix this.

Invalid products error

The data source contains invalid products. This usually means that one of the required fields is missing from some of the products.

The missing fields will be displayed in the feed error status. Refer to the Data source requirements for an overview of which fields are required for Confect.

Other error

This is an unknown error and usually happens if our feed import program crashes while trying to process the feed. Use the "Looking at the data source" section below to manually check out the data source and determine the issue.

Looking at the data source

Simply copy the data source URL link and open it in your browser.

If the data source fails to load you will probably have to ask a developer to look at it.

If it opens you can refer to the Data source requirements to see if the items have all the required fields and are in the correct format.

For examples of other data source types and formats we typically see but do not support, see below.

Examples of unsupported feeds

A lot of different types of feeds for catalog ads exist, however Confect only supports data sources which are formatted for products.

Localization Feeds

A localization feed looks just like a regular product data source but usueally does not contain images and other "shared" info. It only overrides the text fields with translations for another country.

As this doesn’t contain all the required fields, it cannot be used.

<?xml version="1.0" encoding="utf-8" ?>
<rss version="2.0" xmlns:g="http://base.google.com/ns/1.0">
    <channel>
        <title><![CDATA[Facebook Country Feed Localization]]></title>
        <description><![CDATA[Data feed for localizing products in Facebook Catalog.]]></description>
            <item>
            <!-- NORWAY : Basic Product Information -->
            <id><![CDATA[SG_Caps]]></id>
            <override><![CDATA[NO]]></override>
            <title><![CDATA[Product title]]></title>
            <description><![CDATA[A great product description]]></description>
            <g:google_product_category><![CDATA[Google product category]]></g:google_product_category>
            <g:age_group><![CDATA[adult]]></g:age_group>
            <g:size><![CDATA[Onesize]]></g:size>
            <g:color><![CDATA[Color]]></g:color>
            <link><![CDATA[https://product-link]]></link>
            <!-- Availability & Price -->
            <price><![CDATA[269.00 NOK]]></price>
            <sale_price><![CDATA[0.00 NOK]]></sale_price>
            <availability><![CDATA[instock]]></availability>
            <sale_price_effective_date><![CDATA[/]]></sale_price_effective_date>
        </item>
    </channel>
</rss>

Real Estate

The information (attributes) in this data source (i.e. address, neighborhood, etc.) cannot be processed by Confect.

<?xml version="1.0" encoding="UTF-8"?>
<listings>
    <title>example.com Feed</title>
    <link rel="self" href="http://www.example.com"/>
    <listing>
        <home_listing_id>12345678</home_listing_id>
        <name>1 Hacker Way, Menlo Park, CA 94025</name>
        <availability>for_sale</availability>
        <description>An amazing listing</description>
        <address format="simple">
            <component name="addr1">1 Hacker Way</component>
            <component name="city">Menlo Park</component>
            <component name="region">California</component>
            <component name="country">United States</component>
            <component name="postal_code">94025</component>
        </address>
        <latitude>1.11414</latitude>
        <longitude>-1.835003</longitude>
        <neighborhood>Menlo Oaks</neighborhood>
        <image>
            <url>https://image-url.jpg</url>
        </image>
        <listing_type>for_sale_by_agent</listing_type>
        <num_baths>6</num_baths>
        <num_beds>5</num_beds>
        <num_units>1</num_units>
        <price>110000 USD</price>
        <property_type>house</property_type>
        <url>http://www.example.com/link_to_listing</url>
        <year_built>2007</year_built>
        <available_dates_price_config>
            <start_date>2020-11-15</start_date>
            <end_date>2020-12-01</end_date>
            <rate>10000</rate>
            <currency>USD</currency>
            <interval>nightly</interval>
        </available_dates_price_config>
        <available_dates_price_config>
            <start_date>2020-11-15</start_date>
            <end_date>2020-12-01</end_date>
            <rate>50000</rate>
            <currency>USD</currency>
            <interval>weekly</interval>
        </available_dates_price_config>
        <applink property="ios_url" content="example://propertyDetails/1234567"/>
        <applink property="ios_app_store_id" content="7654321"/>
        <applink property="ios_app_name" content="Example App"/>
        <applink property="android_url" content="example://listing/1234567"/>
        <applink property="android_package" content="com.app.example"/>
        <applink property="android_app_name" content="Example App"/>
    </listing>
</listings>

Destination

The information (attributes) in this data source (i.e. latitude, longitude, etc.) cannot be processed by Confect.

<?xml version="1.0" encoding="UTF-8"?>
<listings>
    <title>My Destination Feed</title>
    <link rel="self" href="http://www.example.com"/>
    <listing>
        <destination_id>123456789</destination_id>
        <name>The best destination</name>
        <description>My destination is the best.</description>
        <address format="simple">
          <component name="addr1">1 Market Street</component>
          <component name="city">San Francisco</component>
          <component name="region">California</component>
          <component name="country">United States</component>
          <component name="postal_code">94117</component>
        </address>
        <latitude>37.7712</latitude>
        <longitude>-122.4424</longitude>
        <neighborhood>Mission</neighborhood>
        <neighborhood>SoMa</neighborhood>
        <image>
            <url>http://example.com/some.image_1.jpg</url>
            <tag>City</tag>
            <tag>Package</tag>
        </image>
        <image>
            <url>http://example.com/some.image_2.jpg</url>
            <tag>Tour</tag>
            <tag>Landmark</tag>
        </image>
        <type>city</type>
        <type>culture</type>
        <price>199.99 USD</price>
        <price_change>-20</price_change>
        <url>http://www.example-link</url>
        <applink property="ios_url" content="example-ios://travelapp" />
        <applink property="ios_app_store_id" content="42" />
        <applink property="ios_app_name" content="Travel App iOS" />
        <applink property="iphone_url" content="example-iphone://travelapp" />
        <applink property="iphone_app_store_id" content="43" />
        <applink property="iphone_app_name" content="Travel App iPhone" />
        <applink property="ipad_url" content="example-ipad://travelapp" />
        <applink property="ipad_app_store_id" content="44" />
        <applink property="ipad_app_name" content="Travel App iPad" />
        <applink property="android_url" content="example-android://travelapp" />
        <applink property="android_package" content="com.travelapp" />
        <applink property="android_class" content="com.travelapp.Example" />
        <applink property="android_app_name" content="Travel App Android" />
        <applink property="windows_phone_url" content="example-windows://travelapp" />
        <applink property="windows_phone_app_id" content="64ec0d1b-5b3b-4c77-a86b-5e12d465edc0" />
        <applink property="windows_phone_app_name" content="Travel App Windows" />
    </listing>
</listings>

Hotel

The information (attributes) in this data source (i.e. address, star rating, etc.) cannot be processed by Confect.

<?xml version="1.0" encoding="UTF-8"?>
<listings>
    <title>My Hotel Feed</title>
    <listing>
        <hotel_id>1234</hotel_id>
        <name>The best hotel</name>
        <description>A very nice hotel</description>
        <brand>Premium_brand</brand>
        <address format="simple">
            <component name="addr1">100 Main Street</component>
            <component name="city">North Pole</component>
        <component name="city_id">12345</component>
            <component name="region">ABC</component>
            <component name="country">US</component>
            <component name="postal_code">11111</component>
        </address>
        <latitude>90.00000</latitude>
        <longitude>0.00000</longitude>
        <neighborhood>North Pole</neighborhood>
        <neighborhood>South Hampshire</neighborhood>
        <margin_level>8</margin_level>
        <base_price>199.99 USD</base_price>
        <phone>+12 3-456789</phone>
        <star_rating>4</star_rating>
        <guest_rating>
            <score>7.8</score>
            <rating_system>tripAdvisor</rating_system>
            <number_of_reviewers>300</number_of_reviewers>
        </guest_rating>
        <guest_rating>
            <score>5.1</score>
            <rating_system>tripAdvisor</rating_system>
            <number_of_reviewers>123</number_of_reviewers>
        </guest_rating>
        <image>
            <url>http://example.com/image_1.jpg</url>
            <tag>Swimming pool</tag>
            <tag>Gym</tag>
        </image>
        <image>
            <url>https://example.com/image_2.jpg</url>
            <tag>Lobby view</tag>
            <tag>Overview</tag>
        </image>
        <loyalty_program>Premium_program</loyalty_program>
        <url>http://www.example-link</url>
        <applink property="ios_url" content="example-ios://electronic" />
        <applink property="ios_app_store_id" content="42" />
        <applink property="ios_app_name" content="Electronic Example iOS" />
        <applink property="iphone_url" content="example-iphone://electronic" />
        <applink property="iphone_app_store_id" content="43" />
        <applink property="iphone_app_name" content="Electronic Example iPhone" />
        <applink property="ipad_url" content="example-ipad://electronic" />
        <applink property="ipad_app_store_id" content="44" />
        <applink property="ipad_app_name" content="Electronic Example iPad" />
        <applink property="android_url" content="example-android://electronic" />
        <applink property="android_package" content="com.electronic" />
        <applink property="android_class" content="com.electronic.Example" />
        <applink property="android_app_name" content="Electronic Example Android" />
        <applink property="windows_phone_url" content="example-windows://electronic" />
        <applink property="windows_phone_app_id" content="64ec0d1b-5b3b-4c77-a86b-5e12d465edc0" />
        <applink property="windows_phone_app_name" content="Electronic Example Windows" />
    </listing>
</listings>

Flights

The information (attributes) in this data source (i.e. origin and destination airport, etc.) cannot be processed by Confect.

<?xml version="1.0" encoding="UTF-8"?>
<listings>
    <title>My Flight Feed</title>
    <link rel="self" href="http://www.example.com"/>
    <listing>
        <origin_airport>BOS</origin_airport>
        <destination_airport>SFO</destination_airport>
        <image>
            <url>http://example.com/some.image_1.jpg</url>
            <tag>city</tag>
        </image>
        <image>
            <url>http://example.com/some.image_2.jpg</url>
            <tag>food</tag>
        </image>
        <price>100.00 USD</price>
        <description>Best Flight</description>
    </listing>
</listings>

Vehicle / Automobile

The information (attributes) in this data source (i.e. vehicle id, mileage, etc.) cannot be processed by Confect.

<?xml version="1.0" encoding="UTF-8"?>
<listings>
  <title>Sample Vehicles Feed</title>
  <link rel="self" href="https://www.example.com/dealers/cars/1234/?r=vddn" />
  <listing>
    <vehicle_id>3456553</vehicle_id>
    <title>Ford B-MAX ZETEC</title>
    <description>Adjustable Steering Column, Adjustable Steering Wheel, Air Bags, Air Conditioning, Alloy Wheels, Anti Lock Brakes, Bluetooth Preparation (Phone), CD Player, CD Radio, Driver Airbag, Electric & Heated Door Mirrors, Electric Windows, Electronic Stability Programme (ESP), Front Electric Windows, Front Fog Lights, Height Adjustable Drivers Seat, Passenger Airbag, Power Assisted Steering (PAS), Power Fold &amp; Heated DoorMirrors, Rear Parking Sensor, Remote Boot Release, Remote Central Locking, Solid Paint,LOW MILEAGE WITH A FULL FORD HISTORY, SUPPLIED FROM US,</description>
    <url>https://www.example.com/car-1234>
    <make>Ford</make>
    <image>
      <url>https://www.example.com/1234/image_1.jpg</url>
    </image>
    <image>
      <url>https://www.example.com/1234/image_2.jpg</url>
    </image>
    <image>
      <url>https://www.example.com/1234/image_3.jpg</url>
    </image>
    <model>B-MAX</model>
    <year>2015</year>
    <mileage>
      <value>15617</value>
      <unit>MI</unit>
    </mileage>
    <drivetrain>Other</drivetrain>
    <vin>1A2BCDEF3GH456789</vin>
    <body_style>OTHER</body_style>
    <fuel_type>Gasoline</fuel_type>
    <transmission>Manual</transmission>
    <price>9490 GBP</price>
    <address format="simple">
      <component name="addr1">Sample Road</component>
      <component name="city">Carland</component>
      <component name="region">North Test</component>
      <component name="country">United States of America</component>
      <component name="postal_code">12345</component>
    </address>
    <latitude>37.484419</latitude>
    <longitude>-122.148406</longitude>
    <exterior_color>White</exterior_color>
    <state_of_vehicle>Used</state_of_vehicle>
    <dealer_id>453356</dealer_id>
    <vehicle_registration_plate>AB12CD</vehicle_registration_plate>
    <fb_page_id>5636367576574</fb_page_id>
    <dealer_communication_channel>LEAD_FORM</dealer_communication_channel>
    <dealer_privacy_policy_url>https://www.example.com/privacy/</dealer_privacy_policy_url>
  </listing>
</listings>