Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Partition column as timestamp role didn't recognized in StageDB(Hive) ingestion #983

Closed
kyungtaak opened this issue Dec 3, 2018 · 2 comments
Assignees
Labels
bug Something isn't working @datasource Component Name : Datasource/Connection Management @engine Issues related to engine
Milestone

Comments

@kyungtaak
Copy link
Contributor

kyungtaak commented Dec 3, 2018

Describe the bug
특정 사이트에서 stagedb 적재시 hive 내 timestamp role 로 지정한 partition column 을 제대로 인식하지 못해 적재가 제대로 되지 않는 현상이 발생합니다.

To Reproduce
Steps to reproduce the behavior: Overlord 로그내 전달된 쿼리 내용

  • Input Spec 내 hive 타입
    image
    image
    image

  • Input Spec 내 hadoop 타입으로 변환 결과
    image
    image

  • 결과 : druid.internal 에 oob-row-num 에 값 표시
    image

Expected behavior
partition column 내 값을 인식하여 적재가 정상적으로 동작해야합니다.

Screenshots
(N/A)

Desktop (please complete the following information):
(N/A)

Additional context
(N/A)

@kyungtaak kyungtaak added bug Something isn't working @datasource Component Name : Datasource/Connection Management @engine Issues related to engine labels Dec 3, 2018
@kyungtaak kyungtaak added this to the 3.1.0 milestone Dec 3, 2018
@navis
Copy link

navis commented Dec 3, 2018

하둡 로그 파일에 "Reading from path " 로 시작하는 로그 메시지를 한번 찾아봐 주세요.

@kyungtaak
Copy link
Contributor Author

#1000 의 엔진 이슈에서 처리하여 이상없음을 확인했습니다.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working @datasource Component Name : Datasource/Connection Management @engine Issues related to engine
Projects
None yet
Development

No branches or pull requests

2 participants