idnToAscii(); if (! filter_var($cleanUrl, FILTER_VALIDATE_URL) || ! $urlObj->isHttp()) { return array(array(0 => 'Invalid HTTP Url'), false); } $options = array( 'http' => array( 'method' => 'GET', 'timeout' => $timeout, 'user_agent' => 'Mozilla/5.0 (X11; Fedora; Linux x86_64; rv:45.0)' .' Gecko/20100101 Firefox/45.0', 'accept_language' => substr(setlocale(LC_COLLATE, 0), 0, 2) . ',en-US;q=0.7,en;q=0.3', ) ); stream_context_set_default($options); list($headers, $finalUrl) = get_redirected_headers($cleanUrl); if (! $headers || strpos($headers[0], '200 OK') === false) { $options['http']['request_fulluri'] = true; stream_context_set_default($options); list($headers, $finalUrl) = get_redirected_headers($cleanUrl); } if (! $headers || strpos($headers[0], '200 OK') === false) { return array($headers, false); } try { // TODO: catch Exception in calling code (thumbnailer) $context = stream_context_create($options); $content = file_get_contents($finalUrl, false, $context, -1, $maxBytes); } catch (Exception $exc) { return array(array(0 => 'HTTP Error'), $exc->getMessage()); } return array($headers, $content); } /** * Retrieve HTTP headers, following n redirections (temporary and permanent ones). * * @param string $url initial URL to reach. * @param int $redirectionLimit max redirection follow. * * @return array HTTP headers, or false if it failed. */ function get_redirected_headers($url, $redirectionLimit = 3) { $headers = get_headers($url, 1); if (!empty($headers['location']) && empty($headers['Location'])) { $headers['Location'] = $headers['location']; } // Headers found, redirection found, and limit not reached. if ($redirectionLimit-- > 0 && !empty($headers) && (strpos($headers[0], '301') !== false || strpos($headers[0], '302') !== false) && !empty($headers['Location'])) { $redirection = is_array($headers['Location']) ? end($headers['Location']) : $headers['Location']; if ($redirection != $url) { $redirection = getAbsoluteUrl($url, $redirection); return get_redirected_headers($redirection, $redirectionLimit); } } return array($headers, $url); } /** * Get an absolute URL from a complete one, and another absolute/relative URL. * * @param string $originalUrl The original complete URL. * @param string $newUrl The new one, absolute or relative. * * @return string Final URL: * - $newUrl if it was already an absolute URL. * - if it was relative, absolute URL from $originalUrl path. */ function getAbsoluteUrl($originalUrl, $newUrl) { $newScheme = parse_url($newUrl, PHP_URL_SCHEME); // Already an absolute URL. if (!empty($newScheme)) { return $newUrl; } $parts = parse_url($originalUrl); $final = $parts['scheme'] .'://'. $parts['host']; $final .= (!empty($parts['port'])) ? $parts['port'] : ''; $final .= '/'; if ($newUrl[0] != '/') { $final .= substr(ltrim($parts['path'], '/'), 0, strrpos($parts['path'], '/')); } $final .= ltrim($newUrl, '/'); return $final; } /** * Returns the server's base URL: scheme://domain.tld[:port] * * @param array $server the $_SERVER array * * @return string the server's base URL * * @see http://www.ietf.org/rfc/rfc7239.txt * @see http://www.ietf.org/rfc/rfc6648.txt * @see http://stackoverflow.com/a/3561399 * @see http://stackoverflow.com/q/452375 */ function server_url($server) { $scheme = 'http'; $port = ''; // Shaarli is served behind a proxy if (isset($server['HTTP_X_FORWARDED_PROTO'])) { // Keep forwarded scheme if (strpos($server['HTTP_X_FORWARDED_PROTO'], ',') !== false) { $schemes = explode(',', $server['HTTP_X_FORWARDED_PROTO']); $scheme = trim($schemes[0]); } else { $scheme = $server['HTTP_X_FORWARDED_PROTO']; } if (isset($server['HTTP_X_FORWARDED_PORT'])) { // Keep forwarded port if (strpos($server['HTTP_X_FORWARDED_PORT'], ',') !== false) { $ports = explode(',', $server['HTTP_X_FORWARDED_PORT']); $port = ':' . trim($ports[0]); } else { $port = ':' . $server['HTTP_X_FORWARDED_PORT']; } } return $scheme.'://'.$server['SERVER_NAME'].$port; } // SSL detection if ((! empty($server['HTTPS']) && strtolower($server['HTTPS']) == 'on') || (isset($server['SERVER_PORT']) && $server['SERVER_PORT'] == '443')) { $scheme = 'https'; } // Do not append standard port values if (($scheme == 'http' && $server['SERVER_PORT'] != '80') || ($scheme == 'https' && $server['SERVER_PORT'] != '443')) { $port = ':'.$server['SERVER_PORT']; } return $scheme.'://'.$server['SERVER_NAME'].$port; } /** * Returns the absolute URL of the current script, without the query * * If the resource is "index.php", then it is removed (for better-looking URLs) * * @param array $server the $_SERVER array * * @return string the absolute URL of the current script, without the query */ function index_url($server) { $scriptname = $server['SCRIPT_NAME']; if (endsWith($scriptname, 'index.php')) { $scriptname = substr($scriptname, 0, -9); } return server_url($server) . $scriptname; } /** * Returns the absolute URL of the current script, with the query * * If the resource is "index.php", then it is removed (for better-looking URLs) * * @param array $server the $_SERVER array * * @return string the absolute URL of the current script, with the query */ function page_url($server) { if (! empty($server['QUERY_STRING'])) { return index_url($server).'?'.$server['QUERY_STRING']; } return index_url($server); } /** * Retrieve the initial IP forwarded by the reverse proxy. * * Inspired from: https://github.com/zendframework/zend-http/blob/master/src/PhpEnvironment/RemoteAddress.php * * @param array $server $_SERVER array which contains HTTP headers. * @param array $trustedIps List of trusted IP from the configuration. * * @return string|bool The forwarded IP, or false if none could be extracted. */ function getIpAddressFromProxy($server, $trustedIps) { $forwardedIpHeader = 'HTTP_X_FORWARDED_FOR'; if (empty($server[$forwardedIpHeader])) { return false; } $ips = preg_split('/\s*,\s*/', $server[$forwardedIpHeader]); $ips = array_diff($ips, $trustedIps); if (empty($ips)) { return false; } return array_pop($ips); }