Comments (6)
@spong can you give it a try again? If it does not work, can we pair to investigate it together?
from connectors.
Just pulled the latest from elastic/connectors
, then followed these instructions creating a new github connector within Kibana, updating the config.yml
, then running make install
/make run
and I'm seeing the same error/issue:
![image](https://private-user-images.githubusercontent.com/2946766/357207303-61c42e3c-b221-44db-8233-25831d8a9ec4.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjQwNTg3OTYsIm5iZiI6MTcyNDA1ODQ5NiwicGF0aCI6Ii8yOTQ2NzY2LzM1NzIwNzMwMy02MWM0MmUzYy1iMjIxLTQ0ZGItODIzMy0yNTgzMWQ4YTllYzQucG5nP1gtQW16LUFsZ29yaXRobT1BV1M0LUhNQUMtU0hBMjU2JlgtQW16LUNyZWRlbnRpYWw9QUtJQVZDT0RZTFNBNTNQUUs0WkElMkYyMDI0MDgxOSUyRnVzLWVhc3QtMSUyRnMzJTJGYXdzNF9yZXF1ZXN0JlgtQW16LURhdGU9MjAyNDA4MTlUMDkwODE2WiZYLUFtei1FeHBpcmVzPTMwMCZYLUFtei1TaWduYXR1cmU9ZDQ0ODA1NGU3YzkyZDE2NzFiYzllNTRhYTU4ZTg2NTEwMzBlZGQyMDczNjRiZjcwMzNjMzJkZTM0ODcwYTQwYiZYLUFtei1TaWduZWRIZWFkZXJzPWhvc3QmYWN0b3JfaWQ9MCZrZXlfaWQ9MCZyZXBvX2lkPTAifQ.6RaRzDVjsNmoV0y3G8SlD46qihyg_djtUzhSs5byqzY)
After that error, if I go and update the List of repositories
configuration from security-team
to *
, and then manually add the repo filter as detailed in the description, it syncs without issue:
![image](https://private-user-images.githubusercontent.com/2946766/357207700-e6b0785c-1617-41e3-acf1-589dc41caf33.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjQwNTg3OTYsIm5iZiI6MTcyNDA1ODQ5NiwicGF0aCI6Ii8yOTQ2NzY2LzM1NzIwNzcwMC1lNmIwNzg1Yy0xNjE3LTQxZTMtYWNmMS01ODlkYzQxY2FmMzMucG5nP1gtQW16LUFsZ29yaXRobT1BV1M0LUhNQUMtU0hBMjU2JlgtQW16LUNyZWRlbnRpYWw9QUtJQVZDT0RZTFNBNTNQUUs0WkElMkYyMDI0MDgxOSUyRnVzLWVhc3QtMSUyRnMzJTJGYXdzNF9yZXF1ZXN0JlgtQW16LURhdGU9MjAyNDA4MTlUMDkwODE2WiZYLUFtei1FeHBpcmVzPTMwMCZYLUFtei1TaWduYXR1cmU9NDk0NTUwOGY4ZTQ0NDM5MmI5YWYyZTMxMjYyNTExNjU3ZmI0YTNmMzM3ZmMyZWViNzVmYjlmM2JmMDEzYTIwMyZYLUFtei1TaWduZWRIZWFkZXJzPWhvc3QmYWN0b3JfaWQ9MCZrZXlfaWQ9MCZyZXBvX2lkPTAifQ.loEzdPsKSiMokG1u1tzxeip7TdsF0Y04CIJ_D5eSX9E)
Let me know if you need any more details or feel free to reach out on slack if you'd like to pair -- happy to help however I can 🙂
from connectors.
We are able to index documents from a private repository by specifying the repo in the list of repositories. However, we receive a forbidden error only when the rate limit is exceeded, it applies to both private and public repositories.
from connectors.
@danajuratoni @artem-shelkovnikov Could you please check this & update?
from connectors.
We are able to index documents from a private repository by specifying the repo in the list of repositories. However, we receive a forbidden error only when the rate limit is exceeded, it applies to both private and public repositories.
@spong does this work for you? If yes, can we close this issue? Also, the PR is merged to main
so you can give it a try there as well, meantime we're raising a backport PR.
from connectors.
Sorry @moxarth-elastic, I've been in-and-out on PTO and had been focused on some release items before then so didn't have a chance to confirm/repro. Just catching up on a few things now, but will test and confirm all is good here shortly 👍
from connectors.
Related Issues (20)
- Make connectors work with python 3.10, 3.11 and 3.12
- Incremental Sync should consider updates that doesn't change timestamp
- Connectors services don't shut down immediately if new task added to pool
- Postgres connector: temporary file size exceeds temp_file_limit HOT 5
- In the github connector, for Access Control Sync, allow_access_control field is missing for the document indexed. HOT 4
- Retirement of Office 365 connectors within Microsoft Teams HOT 1
- Postgres advanced sync rules missing in Native Connectors HOT 2
- [MSSQL] Impossible to sync tables that have columns of MSSQL-specific types or even standard datetime
- '_asyncio.Task' object has no attribute 'name' HOT 2
- [MySQL] Connector dies if connection to MySQL times out due to slow ingestion
- Throttle based on cluster capacity HOT 2
- [Dropbox] `file_path` property does not take directory hierarchy into account
- [Confluence] body content for some records includes HTML tags
- Add more INFO logs and metrics when running connectors with data extraction service
- Connector scheduling doesn't handle restarts after scheduled sync time
- MS SQL Connector: Client does not have encryption enabled but it is required by server HOT 6
- Dependency Dashboard
- Elasticsearch OneDrive native connector is missing to index the field mime-type. HOT 2
- Network Drive connector DLS mapping CSV gives error - IndexError: list index out of range HOT 4
- [ServiceNow] Connector to support custom tables HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from connectors.