Scraping food recipe

[rabol]

Hello

I have used https://github.com/ssnepenthe/recipe-scraper to scrape some food recipes but I would like to use Roach as it feels like on can have more control.

I have seen the https://bestofphp.com/repo/ksassnowski-roach-example-project, but I'm still a little uncertain on how to scrape something like: https://spainonafork.com/authentic-spanish-seafood-paella-recipe/

Any hint is highly appreciated

Kind regards
Steen

[ksassnowski]

Is there a particular part of the page you're having trouble with? It's easier to help you if have concrete examples.

[rabol]

The page is : https://spainonafork.com/authentic-spanish-seafood-paella-recipe/ as written in the original question :)

<div id="wprm-recipe-container-12640" class="wprm-recipe-container" data-recipe-id="12640" data-servings="2">

would be the starting point I think i would have to use the css selector, but from there I don't really get the process of traversing the children

[rabol]

Hi
(using the url from previous post)

I would expect to get specific 'element' and the children' like this:

$arrIt = $response->filter('div.wprm-recipe-container')->children()->getIterator();

while($arrIt->valid()) {
    debug($arrIt->current());
    $arrIt->next();
}

[rabol]

Here is the result:

/**
     * @param Response $response
     * @return Generator
     */
    public function parse(Response $response): Generator
    {
        yield $this->item([
            'title' => $response->filter('h2.wprm-recipe-name')->text(''),
            'summary' => $response->filter('div.wprm-recipe-summary')->text(''),
            'course' => $response->filter('span.wprm-recipe-course')->text(''),
            'ingredients' => $response->filter('ul.wprm-recipe-ingredients li')->each(fn ( Crawler $entry) => $entry->text()),
            'instructions' => $response->filter('ol.wprm-recipe-instructions li')->each(fn(Crawler $entry) => $entry->text()),
            'prepTime' => $response->filter('span.wprm-recipe-details.wprm-recipe-details-minutes.wprm-recipe-prep_time.wprm-recipe-prep_time-minutes')->text(''),
            'cookTime' => $response->filter('span.wprm-recipe-details.wprm-recipe-details-minutes.wprm-recipe-cook_time.wprm-recipe-cook_time-minutes')->text(''),
            'cuisine' => $response->filter('span.wprm-recipe-cuisine')->text(''),
            'yield' => $response->filter('span.wprm-recipe-details.wprm-recipe-servings')->text(''),
            'calories' => $response->filter('span.wprm-recipe-details.wprm-recipe-calories')->text(''),
            'keywords' => explode(",", trim(str_replace('Tags:','', $response->filter('div.col-md-6.col-sm-6.nancy-tags')->text('')))),
            'nutrition' => [
                'fat' => trim(str_replace('Fat','', $response->filter('div.nutrition-item.nutrition-item-fat > span.nutrition-main')->text(''))),
                'sodium' => trim(str_replace('Sodium','', $response->filter('div.nutrition-item.nutrition-item-sodium > span.nutrition-main')->text(''))),
                'potassium' => trim(str_replace('Potassium','', $response->filter('div.nutrition-item.nutrition-item-potassium > span.nutrition-main')->text(''))),
                'carbohydrates' => trim(str_replace('Carbohydrates','', $response->filter('div.nutrition-item.nutrition-item-carbohydrates > span.nutrition-main')->text(''))),
                'protein' => trim(str_replace('Protein','', $response->filter('div.nutrition-item.nutrition-item-protein > span.nutrition-main')->text('')))
            ]
        ]);
    }