catalan-adobe / acom-franklin-import-sections-mapping Goto Github PK
View Code? Open in Web Editor NEWCLI for executing adobe.com Franklin import using sections mapping flow
CLI for executing adobe.com Franklin import using sections mapping flow
Original page: https://business.adobe.com/products/primetime/adobe-media-server.html
The original page contains invisible sections with content which ends up in the docx generated via the generic import script.
This issue lists Renovate updates and detected dependencies. Read the Dependency Dashboard docs to learn more.
These updates have all been created already. Click a checkbox below to force a retry/rebase of any.
@semantic-release/github
, @semantic-release/npm
, eslint
, semantic-release
).github/workflows/branch.yml
actions/checkout v4
actions/setup-node v4
.github/workflows/release.yml
actions/checkout v4
actions/setup-node v4
package.json
@adobe/helix-importer ^3.0.0
@flatten-js/core ^1.3.5
axios ^1.3.4
exceljs ^4.3.0
express ^4.18.2
franklin-bulk-shared 1.17.1
glob ^10.0.0
serve-index ^1.9.1
sharp ^0.33.0
terminal-kit ^3.0.0
yargs ^17.7.1
@semantic-release/changelog ^6.0.3
@semantic-release/git ^10.0.1
@semantic-release/github ^9.0.0
@semantic-release/npm ^11.0.0
eslint 8.57.0
eslint-config-airbnb-base 15.0.0
eslint-plugin-import 2.29.1
semantic-release ^22.0.0
node >=18.15.0
Example: https://business.adobe.com/products/experience-manager/managed-services.html
Current section detection algorithm exclude sections with x > 0
and width < ~.98 pageWidth
.
With the NSiblingsElements approach used to find the page sections, we do not need such strict checks on x position and page width.
Notice the narrower section is now detected and extracted.
acom-sections-mapping prepare
is not extracting some sections on some pages.
Example page: https://business.adobe.com/products/adobe-experience-cloud-products.html
Run
echo 'https://business.adobe.com/products/adobe-experience-cloud-products.html' | node index.js prepare -i
Then
=> In sections-mapping/data
, find the screenshots for that page, notice the bottom red marquee is missing
business.adobe.com has akamai layer that checks for pages being loaded in "automation", in our case a headless browser. The function we use to launch the headless browser already implements basic mechanism to "hide" its headless state (like sanitizing the user-agent) but it's not enough.
By sniffing the network requests, we can see 403
responses on extra HTML resources fetched from the page (like plain HTML from fragments).
Until we find ways to not be detected as headless, we can report back in the output when we capture such issue + notify to re-run the command in non headless mode, using --no-headless
.
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.